Senior Data Engineer

Expectations for Success:   

• Facilitate and execute the collection, processing, and analysis of virtually all business data  
• Build ETL processes, across a wide array of just about every kind of database system   
• Write code to interact with an untold number of internal and external APIs and systems  
• Design complex queries to crunch data and produce summary and aggregate datasets  
• Combine and correlate large datasets from multiple data sources, and analyze for integrity  
• Build and maintain various self-service data platforms and tools for internal use  
• Help maintain the cloud-based Data Warehouse central to our efforts  
• Generally speaking, manipulate and move a lot of data around from one place to another  
• You think in SQL  
• You daydream about data schema  
• You wish you could automate everything  
• You find it offensive when a system lacks a robust API  
• You’re more likely to get distracted by a good chart than your social media feed  
• You don’t think there’s anything you couldn’t do, when it comes to software development  

Job Qualifications:

• 7+ years of professional software development  
• At least 5 of those years specifically working directly with data  
• At least 3 years working in the cloud (AWS, GCP, or Azure) preferred  
• At least 3 years working with Big Data concepts and systems, preferred  
• At least 1 year working with Apache Airflow  
• Some exposure to non-relational or NoSQL database systems  
• Deep knowledge of and experience with multiple SQL dialects  
• Fluency in Python  
• Proficiency with shell scripting and Linux  
• Knowledge of modern web technologies and architecture  
• Foundational understanding of object-oriented programming concepts  
• Exceptional communication, both with technical and non-technical stakeholders  
• Experienced collaboration skills, up/down/across a mid-sized organization  
• Ability to thrive in a landscape of rapid evolution and varied tasks  
• Ability to see tasks thru from requirements gathering all the way to deployment  
• A strong tendency to be self-driven and self-motivated  
• Significant Experience with at least one of  Java, JS/ECMAScript, C/C++, C#  
• PostgreSQL, MySQL  
• AWS: SQS, SNS, Lambda, DynamoDB, or similar from Google Cloud  
• AWS Redshift, Google BigQuery, Snowflake