Hippocratic AI has developed a safetyfocused Large Language Model (LLM) for healthcare. The company believes that a safe LLM can dramatically improve healthcare accessibility and health outcomes in the world by bringing deep healthcare expertise to every human. No other technology has the potential to have this level of global impact on health.
Innovative Mission: We are developing a safe, healthcarefocused large language model (LLM) designed to revolutionize health outcomes on a global scale.
Visionary Leadership: Hippocratic AI was cofounded by CEO Munjal Shah, along with a group of physicians, hospital administrators, healthcare professionals, and artificial intelligence researchers from leading institutions, including El Camino Health, Johns Hopkins, Stanford, Microsoft, Google, and NVIDIA.
Strategic Investors: We have raised a total of $278 million in funding, backed by top investors such as Andreessen Horowitz, General Catalyst, Kleiner Perkins, NVIDIAs NVentures, Premji Invest, SV Angel, and six health systems.
WorldClass Team: Our team is composed of leading experts in healthcare and artificial intelligence, ensuring our technology is safe, effective, and capable of delivering meaningful improvements to healthcare delivery and outcomes.
For more information, visit
We value inperson teamwork and believe the best ideas happen together. Our team is expected to be in the office five days a week in Palo Alto, CA, unless explicitly noted otherwise in the job description.
We are seeking a Director of Engineering Platform Engineering to lead the design, implementation, and operation of HippocraticAIs cloud infrastructure, observability systems, and GPU control plane . This leader will be responsible for scaling our global compute fabric to support cuttingedge LLM workloads while maintaining exceptional reliability, security, and cost efficiency.
You will build and lead a multidisciplinary engineering team spanning cloud operations, SRE, and GPU orchestration , working closely with product development, AI research, and compliance to deliver worldclass infrastructure for healthcare AI.
Team Building & Leadership
Recruit and develop a worldclass platform engineering team.
Foster a culture of innovation, accountability, and technical excellence.
Mentor and coach engineers and managers to achieve high performance and career growth.
Infrastructure Leadership
Build and scale a highperforming team responsible for all infrastructure operations and systems reliability.
Define and execute the longterm infrastructure roadmap for a multicloud, multiregion GPU and compute environment.
Drive excellence in cloud cost optimization, capacity planning, and service reliability.
Cloud Operations & Control Plane
Architect and manage HippocraticAIs global GPU control plane , enabling dynamic provisioning, scheduling, and monitoring of inference workloads across regions and providers.
Lead the design and automation of deployments (AWS, GCP, Azure, onprem) using infrastructureascode and CI/CD best practices.
Ensure strong security posture and compliance across all environments, aligned with HIPAA, SOC 2, and other healthcare data standards.
Observability & Reliability
Develop and scale comprehensive observability systems covering telemetry, tracing, logging, and alertingto ensure full visibility into production systems and AI workloads.
Establish SLOs, SLIs, and SLAs for all missioncritical services and infrastructure.
Implement robust incident management, root cause analysis, and continuous improvement processes.
Technical Strategy & Collaboration
Partner with AI and product teams to anticipate infrastructure needs and design scalable architectures for rapid experimentation and deployment.
Contribute to the design of internal developer platforms that improve productivity and standardization.
Evaluate emerging technologies (e.g., new GPU hardware, orchestration frameworks, data center partnerships) to advance our capabilities.
Must Have:
10+ years of engineering experience, including 5+ years leading infrastructure, SRE, or platform teams at scale.
Proven success in managing largescale distributed systems and global cloud infrastructure.
Deep experience with highperformance computing or largescale AI workloads .
Strong background in cloud platforms (AWS, GCP, Azure) and infrastructureascode (Terraform, Pulumi, etc.).
Expertise in observability stacks (Prometheus, Grafana, OpenTelemetry, Datadog, etc.) and operational excellence.
Experience with security and compliance frameworks relevant to healthcare (HIPAA, SOC 2).
Exceptional communication skills and the ability to partner across product, AI research, and operations.
NicetoHave:
Experience designing or operating GPU control planes or schedulers (e.g., Kubernetes, Ray, Slurm, custom orchestration frameworks).
Prior work with ML infrastructure , data pipelines, or modelserving platforms.
Background in cost optimization and sustainability of GPU/compute operations.
Familiarity with edge or hybridcloud deployments for lowlatency AI systems.
***Be aware of recruitment scams impersonating Hippocratic AI. All recruiting communication will come from @hippocraticai.com email addresses. We will never request payment or sensitive personal information during the hiring process. If anything
#J-18808-Ljbffr...Software Engineer, Full-Stack Developer Experience Were building the next generation of OpenAIs internal developer experience, whether theyre working human-only, agent-only, or fully hybrid. As AI changes how software gets written, reviewed, tested, and shipped,...
...A leading paint and coatings company is seeking a part-time Store Associate in Circleville, Ohio. Candidates will provide excellent customer... ...preferred. This role offers a hiring rate of $13.75/hr and requires flexibility for evening and weekend shifts. #J-18808-Ljbffr...
...must have a Doctorate of Physical Therapy at the start of the residency program Entry level position, no experience required. Prefer acute care internship experience. Current Physical Therapist License or Physical Therapist License Applicant in the State of California...
...Job Description Job Description Revenue Manager (On-Site) Pay Range for this role is $90,000-$100,000 + Benefits/Perks! Kimpton... ...displacement, and overall commercial strategy. Oversee reservations operations, ensuring accurate rate loading, inventory controls, and...
...High School Girls Cross Country Assistant Coach Join to apply for the High School Girls Cross Country Assistant Coach role at Cuyahoga Valley Christian Academy (CVCA) . Biblical Principles And Expectations All employees proclaim the Gospel of Jesus Christ through...