Job Summary
vidIQ is seeking a highly-motivated Senior Data Engineer with 4+ years of hands-on data engineering experience to join our growing team. The ideal candidate will be a go-getter with the ability to work independently. In this role, you will have oversight of partitioning data, building an ETL pipeline, data compaction, and AWS optimization. You must be highly collaborative and a self-starter who is able to work in a fast-paced environment. Strong communication skills are essential in this role, as it will be integral in communicating to the back-end team where and how to implement data integration and persistence. You will also communicate to management the volumes of data we are gathering, as well as communicate the data access points and how to use this data, to the team and management.
- Minimum Qualification:Degree
- Experience Level:Mid level
- Experience Length:4 years
Job Description/Requirements
- Building efficient, critical data pipelines, including ETL, partitioning data, data compaction, and AWS optimization
- Collaborate closely with data scientists, and product analysts to create the data sets that power vidIQ’s algorithms
- Be an advocate for data quality, acquisition of new data sources, and data infrastructure tooling
- Work closely with cross-functional teammates, including product managers, designers, product analysts, and data scientists, to deliver the highest impact to our users
Job requirements:
- 4+ years experience using Python for internal data pipelines (moving data inside AWS account) numpy, pandas
- Additional experience with DynamoDB, Lambda, Athena, Iceberg, S3, AWS Glue, familiarity with Spark preferred
- Hands-on experience with data workflow orchestration (Airflow)
- Proven track record of working with cross-functional teams in an agile-like environment
- Ability to communicate data concepts, requirements, and risks clearly to cross-functional team members, especially product analysts, data scientists, and product managers
- Preferably, you have experience developing ML-based products & services
Important Safety Tips
- Do not make any payment without confirming with the Jobberman Customer Support Team.
- If you think this advert is not genuine, please report it via the Report Job link below.
