Responsibilities

📍AI Model Training Pipeline Management Design, develop, and maintain scalable and efficient data pipelines for training AI models. 📍Collaborate with AI engineers and company management to understand requirements and implement solutions that result in improved model performance 📍Implement data versioning, tracking, and monitoring systems to ensure the quality and historical preservation of training data 📍Business Analytics Platform 📍Lead the management and optimization of business analytics platforms, enabling stakeholders to derive actionable insights from diverse datasets including but not limited to behavioral data, transactional data, survey data 📍Collaborate with cross-functional teams to gather business requirements and translate them into data engineering solutions 📍Ensure data consistency, accuracy, and reliability within the business analytics platforms. 📍Data Governance and Security 📍Enforce data governance policies and security measures to protect sensitive information 📍Collaborate with the security team to implement and maintain data privacy standards and compliance 📍Documentation and Knowledge Sharing 📍Create and maintain comprehensive documentation for data pipelines, ensuring knowledge transfer within the team

Qualifications

📍Bachelor's or Master's degree in Computer Science, Data Science, or a related field. 📍5 years’ experience as a Data Engineer with a focus on data pipelines, cloud data solutions, analytics databases, visualization tools and business analytics platforms. Direct experience with AI model pipelines is a plus, but not required. 📍Strong proficiency in SQL, Python, and Linux. Comfortable with or ability to learn light Javascript for light tool configuration. 📍Experience working with large data sets, both structured and unstructured. Experience converting unstructured JSON and other data types into structured data in a scalable, automated manner. 📍Understanding of machine learning model types and generative AI concepts is a plus. 📍Experience with cloud based data and image management platforms such as BigQuery, Snowflake, Redshift, and S3. 📍In-depth knowledge of database systems, data warehousing, and ETL and data orchestration processes.