Create New Account
Sign up to continue searching for suitable jobs in Web 3.0

OR
Terms of Use
Already have an account?

Log In to Your Account
Log in to continue searching for suitable jobs in Web 3.0

OR
Don’t have an account?
Limit Break
Staff Data Pipeline Engineer
about 1 year ago | 926 views | 1 applications

Staff Data Pipeline Engineer

Full-time
United States
Per year
$220,000 To $300,000

About the company

We combine the power of Web3 and creativity to build experiences that connect people from all corners of the globe.

Job Summary

Responsibilities. What you’ll do

📍Take ownership of and developing critical infrastructure and new features for our next-generation analytics platform, supporting central functions such as marketing, live ops and finance 📍 Build scalable, accurate, and extensible stream processing applications using Spark, Kafka, Hive, Druid, Airflow, Scala/Java 📍Ensure best practices and standards in our data ecosystem. 📍 Establish and improve automation process and optimization of data infrastructure. 📍Collaborate with cross disciplinary teams, and effectively communicate with stakeholders.

Requirements. Who you are and what you’ve done

📍 5+ years software engineering experience 📍3+ years of data engineering experience, especially working on back-end data infrastructure. 📍 Extensive experience with Java, Python, Kafka, Druid, Hadoop/EMR 📍 Experience building highly scalable real-time and batch processing data pipelines. 📍 Bachelor's degree in computer science/statistics/mathematics, data engineering, or other fields with equivalent proven engineering experience 📍 Understanding of tradeoffs between off the shelf services and home-grown solutions 📍 Experience with workflow orchestration tools such as Oozie, Luigi, and AirflowExperience with SQL and SQL-like languages 📍 Proficiency in writing well-tested code, including unit-testing, integration testing and end-to-end testing.

Similar jobs

about 22 hours ago | 16 views | Be the first one to apply
about 22 hours ago | 21 views | 1 applications
about 22 hours ago | 16 views | Be the first one to apply
Full-time
Hong Kong, Asia
about 22 hours ago | 18 views | Be the first one to apply
Full-time
San Francisco, North America
$112,000 To $166,000 per year
about 23 hours ago | 12 views | Be the first one to apply
Full-time
United States, North America
$108,000 To $135,000 per year