About the company
ightCI is a full-service tech partner that enables the best companies in the world to build exceptional products and up-skill their teams. Our full-service capabilities allow us to create a bespoke experience to meet the specific needs of your business. From building disruptive products to hiring top talent, our company is designed to support anything and everything in between.
Job Summary
Deliverables
📍In this hands-on role, you’ll build the architecture, and models [for what the data will look like] within the first 1-2 weeks 📍You’ll take ownership of the ETL process for 3rd party data, automating as much as possible to enhance efficiency and reduce manual intervention 📍You will lead the effort to standardize data formats and structures, making it easier to analyze and derive valuable insights 📍Utilize your expertise in data transformation techniques to enrich raw data, making it more accessible and valuable for analytics and reporting purposes 📍Continuously monitor data pipelines and proactively address performance bottlenecks 📍Work closely with data scientists, analysts, and other stakeholders to understand their data requirements and assist in building data solutions that cater to their needs
About you
đź“ŤFamiliarity with Big Data technologies like Apache Hadoop, Apache Spark, and their respective ecosystems đź“ŤExperience in building and optimizing data pipelines, architectures, and data sets đź“ŤAbility to create data models and have knowledge of normalization and denormalization techniques đź“ŤExpertise in working with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra) đź“ŤExperience with ETL (extract, transform, load) processes, and tools like Apache NiFi, Talend, or Microsoft SSIS đź“ŤProficiency in programming languages, particularly Python and Typescript to develop data processing scripts
