Data Engineer Job at Qode, Pittsburgh, PA

NFBzWWZQaTd0TjVIQUFHVDNDcU91SDFFOGc9PQ==
  • Qode
  • Pittsburgh, PA

Job Description

Job Description

Job Description

Job Summary:

We are seeking a skilled and motivated Data Engineer with strong expertise in PySpark, SQL to join our Data Engineering team. You will be responsible for designing, building, and maintaining scalable data pipelines and processing systems that support our business intelligence, analytics, and machine learning initiatives.

Key Responsibilities:
  • Develop and maintain scalable, robust data pipelines using Scala and big data technologies.
  • Work with large datasets from multiple sources to ingest, transform, and make data available for analytics and reporting.
  • Collaborate with Data Scientists, Analysts, and other engineers to understand data requirements and deliver efficient solutions.
  • Optimize ETL jobs for performance and cost.
  • Ensure data quality, governance, and consistency across all environments.
  • Monitor production jobs, troubleshoot issues, and ensure system reliability.
  • Implement best practices for data engineering, including code reviews, testing, and documentation.
Required Qualifications:
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • 6+ years of experience as a Data Engineer or in a similar role.
  • Strong skills in PySpark and SQL (experience with functional programming is a plus).
  • Hands-on experience with big data tools like Apache Spark , Kafka , Hadoop , or Hive .
  • Proficiency in building ETL pipelines and working with structured and unstructured data.
  • Experience with cloud platforms (e.g., AWS , Azure , GCP ) and their data services.
  • Familiarity with version control systems (e.g., Git ), CI/CD, and DevOps practices.
  • Solid understanding of data warehousing and data modeling concepts.
Preferred Qualifications:
  • Knowledge of SQL and database systems such as Postgres, Redshift, or Snowflake.
  • Exposure to containerization technologies like Docker and orchestration tools like Airflow or Kubernetes.

Job Tags

Similar Jobs

Amergis Locum Tenens

Plastics - Hand Surgery Physician Job at Amergis Locum Tenens

 ...Greetings! We have a wonderful opportunity for Plastic and Reconstructive Surgeons in Greenville, NC! We are seeking a board certified surgeon for plastics, hand and face surgery. Highlights: - Lucrative rates with weekly pay - Flexible contract lengths -... 

VetJobs

Amazon Warehouse Associate (Suffolk,VA Area) Job at VetJobs

 ...to apply: Job Overview You'll be part of the Amazon warehouse team that gets orders ready for customers relying on...  ..., make-on-demand, customer returns, Prime Now, and general fulfillment. You will be selecting, packing, and shipping orders - in some... 

Randall L Miller Dds LLC

Dental Assistant Job at Randall L Miller Dds LLC

Job Description Job Description Looking for a Dental Assistant to join our team - fast paced office with lots of variety! Monday - Thursday 730-5 - experience preferred but not mandatory - will train the right person! Xray certification required!

Kids 'R' Kids Concord

House Keeper, Janitor, Cleaner Job at Kids 'R' Kids Concord

Responsibilities:- Perform general housekeeping duties to ensure a clean and orderly environment- Clean and maintain assigned areas,...  ...Assist with industrial cleaning tasks such as buffing floors and deep cleaning carpets- Collaborate with other team members to... 

SavATree

Sales Arborist Job at SavATree

 ...preferred and will accelerate your learning journey! Looking for a role you can thrive in and make an impact? In the Sales Arborist role, you will have the opportunity to work closely with our field specialists who deliver work and new and existing customers while...