Job Description

Job Title: Sr. Data Engineer-ETL

Location: Denver, CO

Duration: Long-term

Main Skill:

Over 10+ years of experience in the Software Development Industry.
We need data Engineering exp - building ETLS using spark and sql, real time and batch pipelines using Kafka/firehose, experience with building pipelines with data bricks/snowflake, experience with ingesting multiple data formats like json/parquet/delta etc.

Job Description:

About You

You have a BS or MS in Computer Science or similar relevant field
You work well in a collaborative, team-based environment
You are an experienced engineering with 3+ years of experience
You have a passion for big data structures
You possess strong organizational and analytical skills related to working with structured and unstructured data operations
You have experience implementing and maintaining high performance / high availability data structures
You are most comfortable operating within cloud based eco systems
You enjoy leading projects and mentoring other team members

Specific Skills:

Over 10 years of experience in the Software Development Industry.
Experience or knowledge of relational SQL and NoSQL databases
High proficiency in Python, Pyspark, SQL and/or Scala
Experience in designing and implementing ETL processes
Experience in managing data pipelines for analytics and operational use
Strong understanding of in-memory processing and data formats (Avro, Parquet, Json etc.)
Experience or knowledge of AWS cloud services: EC2, MSK, S3, RDS, SNS, SQS
Experience or knowledge of stream-processing systems: i.e., Storm, Spark-Structured-Streaming, Kafka consumers.
Experience or knowledge of data pipeline and workflow management tools: i.e., Apache Airflow, AWS Data Pipeline
Experience or knowledge of big data tools: i.e., Hadoop, Spark, Kafka.
Experience or knowledge of software engineering tools/practices: i.e., Github, VSCode, CI/CD
Experience or knowledge in data observability and monitoring
Hands-on experience in designing and maintaining data schema life-cycles.
Bonus - Experience in tools like Databricks, Snowflake and Thoughtspot

Job Tags

Similar Jobs

Allegro Home Delivery

IC Complex Appliance Installer- Multi-Family Projects- Raleigh, NC Job at Allegro Home Delivery

...About the job Appliance Delivery Driver/Installer Allegro Home Delivery is a fast-growing company beginning to disrupt the last mile home delivery market.Allegro Home Delivery is looking for an Owner Operator/Independent Service Provider Driving Team for appliance...

Doug Parr Homes

Director of Sales & Marketing - (Homebuilder experience required) Job at Doug Parr Homes

Doug Parr Homes is currently looking for a Director of Sales and Marketing. We are a Christian based, family-oriented company looking for a great team player with a terrific work ethic. Come join our growing team! We are expanding in other areas of the DFW market as well...

Milestone Construction, LLC

Marketing Manager Job at Milestone Construction, LLC

**Email resumes to ****@*****.*** Role Summary Milestone Construction is seeking a Marketing Manager to oversee and coordinate the companys marketing efforts. This role supports brand consistency, business development, and community visibility while working...

Fuse Technical Group

Driver Job at Fuse Technical Group

...competitive incentive packages, exceptional benefits, and an excellent culture for career growth. About the role: The Warehouse Driver Position provides direct receiving and distribution of inventory and show product to our various clients and events, as well as...

Leonard Workforce Solutions

Job Order Director of Case Management Job at Leonard Workforce Solutions

Facility Case Management Director (RN/LCSW/LMSW) Full-Time | Administrative Leadership Role About the Role The Facility Case Management Director is responsible for the overall leadership, management, and coordination of the hospitals Case Management Department. ...

Sr Data Engineer-ETL Job at InfoVision Inc., Denver, CO

MForcDdGQ2xFL0hsWUhvTk9rU1VQajF6