About the company
Backed by industry-leading entrepreneurs and investors, Heretic Ventures builds companies at the intersection of culture, commerce, and creators, with a focus on using disruptive technology, like AI, to gain widespread adoption and lasting competitive advantage.
Job Summary
Responsibilities
šCollaborate with cross-functional teams to deploy and maintain AI models in production environments, ensuring scalability, reliability, efficiency, and robustness šOrchestrate model serving to accommodate our unique infrastructure in a scalable manner šMaintain backend planning and optimize GPU capacity continuously šBuild tools for end-to-end ML model deployment and lifecycle management šBuild tools to monitor model performance šRecommend options for end-to-end Ops pipelines that are needed to drive various business plans šStay up-to-date with the latest advancements in AI technologies and research, and apply them to enhance performance and capabilities
Qualifications
šBachelor's or Master's degree in Computer Science, AI/ML, or a related field š2+ years of professional ML deployment experience on scale, preferably MLOps for LLMs and/or diffusion models š2+ years of experience with cloud platforms (e.g., AWS, Azure, OCI, Google Cloud) and experience with deploying AI models in cloud-based environments šProficiency in containerization technologies as Docker, inference servers as Triton and container orchestration platforms as Kubernetes šProven experience in working with and scaling GPUs šExperience partnering with back-end & front-end eng to tie AI/ML infrastructure to a scaled front-end experience šStrong knowledge of Python, with experience in popular machine learning libraries (e.g., TensorFlow, PyTorch, Spark) šSolid understanding of machine learning concepts and algorithms. šExtensive Linux troubleshooting experience šExcellent problem-solving and analytical thinking skills, with a strong attention to detail šEffective communication and teamwork abilities, with the capacity to work in a fast-paced, collaborative environment