Data Engineer Job at Qode, Pittsburgh, PA

dmY4c2xFbG9vOVBBWC95QnhVS3BYOHRkZGc9PQ==
  • Qode
  • Pittsburgh, PA

Job Description

Job Description

Job Description

Job Summary:

We are seeking a skilled and motivated Data Engineer with strong expertise in PySpark, SQL to join our Data Engineering team. You will be responsible for designing, building, and maintaining scalable data pipelines and processing systems that support our business intelligence, analytics, and machine learning initiatives.

Key Responsibilities:
  • Develop and maintain scalable, robust data pipelines using Scala and big data technologies.
  • Work with large datasets from multiple sources to ingest, transform, and make data available for analytics and reporting.
  • Collaborate with Data Scientists, Analysts, and other engineers to understand data requirements and deliver efficient solutions.
  • Optimize ETL jobs for performance and cost.
  • Ensure data quality, governance, and consistency across all environments.
  • Monitor production jobs, troubleshoot issues, and ensure system reliability.
  • Implement best practices for data engineering, including code reviews, testing, and documentation.
Required Qualifications:
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • 6+ years of experience as a Data Engineer or in a similar role.
  • Strong skills in PySpark and SQL (experience with functional programming is a plus).
  • Hands-on experience with big data tools like Apache Spark , Kafka , Hadoop , or Hive .
  • Proficiency in building ETL pipelines and working with structured and unstructured data.
  • Experience with cloud platforms (e.g., AWS , Azure , GCP ) and their data services.
  • Familiarity with version control systems (e.g., Git ), CI/CD, and DevOps practices.
  • Solid understanding of data warehousing and data modeling concepts.
Preferred Qualifications:
  • Knowledge of SQL and database systems such as Postgres, Redshift, or Snowflake.
  • Exposure to containerization technologies like Docker and orchestration tools like Airflow or Kubernetes.

Job Tags

Similar Jobs

Jerry

Senior creative producer / strategist growth Job at Jerry

 ...talent-dense environment and accelerate your career growth exponentially. Take the holistic ownership of creative excellence - from production, strategy, to agency management About The Role At Jerry, we are redefining and radically improving how people manage... 

Spectrum Center Schools and Programs

Special Education Teacher Job at Spectrum Center Schools and Programs

 ...,000 /year based on experience PLUS $2,000 Annual Education Stipend &##127979; Environment: Special Education Program, Grades K-12 Spectrum Center Schools...  ...to offer hope, is seeking a Special Education Teacher to join our award-winning team and perform... 

Furniture City Inc

Furniture Assembler / Warehouse Job at Furniture City Inc

Job Description Job Description Benefits: Employee discounts Flexible schedule Opportunity for advancement Benefits/Perks Flexible Schedule Competitive Pay Career Advancement Job Summary We are seeking a skilled Furniture Assembler to join...

Baseten

Senior Brand Designer Job at Baseten

 ...Spark Capital, Greylock, and Conviction, were scaling our team to meet accelerating customer demand. The Role As a Senior Brand Designer at Baseten, youll help shape and evolve our brand identity across everything we create - marketing assets, landing pages, event... 

Burger King - EYAS

General Manager Job at Burger King - EYAS

 ...Job Description Job Description General Manager Burger King Eyas Hospitality Group (EHG) has exciting new opportunities. EHG currently owns and operates 54 Burger King restaurants in North Carolina, with expansion plans in the Southeast. Our philosophy...