Remote Data Engineer Job at Software Technology Inc, Washington DC

  • Software Technology Inc
  • Washington DC

Job Description

Remote Data EngineerKey Responsibilities:Designs and automates deployment of our distributed system for ingesting and transforming data from various types of sources (relational, event-based, unstructured).Designs and implements framework to continuously monitor and troubleshoot data quality and data integrity issues.Implements data governance processes and methods for managing metadata, access, retention to data for internal and external users.Designs and provide guidance on building reliable, efficient, scalable and quality data pipelines with monitoring and alert mechanisms that combine a variety of sources using ETL/ELT tools or scripting languages.Designs and implements physical data models to define the database structure.Optimizing database performance through efficient indexing and table relationships.Participates in optimizing, testing, and troubleshooting of data pipelines.Designs, develops and operates large scale data storage and processing solutions using different distributed and cloud based platforms for storing data (e.g. Data Lakes, Hadoop, Hbase, Cassandra, MongoDB, Accumulo, DynamoDB, others).Uses innovative and modern tools, techniques and architectures to partially or completely automate the most-common, repeatable and tedious data preparation and integration tasks in order to minimize manual and error-prone processes and improve productivity.Assists with renovating the data management infrastructure to drive automation in data integration and management.Ensures the timeliness and success of critical analytics initiatives by using agile development technologies such as DevOps, Scrum, Kanban Coaches and develops less experienced team membersSkillset:Hands-on Azure Data experienceTools to have: Databricks, Synapse, Data Factory, etc.

Job Tags

Similar Jobs

Charter Communications

Multimedia Journalist - Spectrum News 1 Job at Charter Communications

This role requires the ability to work lawfully in the U.S. without employment-based immigration sponsorship, now or in the future.About the RoleAre you a storyteller at heart? Do you want to shine a light on the issues that matter? Apply to be a Multimedia Journalist...

JRS Pharma LP

Production Operator Job at JRS Pharma LP

Description: JRS Pharma LP is seeking an experienced night shift Dex Production Operator to join our growing U.S. Cedar Rapids, IA team as a key contributor to our manufacturing operations. This role plays a vital part in ensuring the safe, efficient and precise production... 

JT’s Urban Italian

Pizza Chef Job at JT’s Urban Italian

 ...Experienced Pizza Cook $22$28+ per hour | Full-Time | Benefits | Growth Opportunity JTs Buffalo is a busy, contemporary Italian restaurant located in Buffalos Elmwood Village. We are part of a locally owned restaurant group with more than 30 years of experience operating... 

University of Delaware

Surveillance Field Investigator - Company Vehicle & Benefits Job at University of Delaware

A nationwide private detective agency is hiring full-time field investigators in Austin, Texas. No prior experience is required as training and licensing will be provided. Responsibilities include conducting video surveillance, maintaining vehicle logs, and frequent regional... 

Canon Virginia Inc

Machinist C (Experienced Machinist) Job at Canon Virginia Inc

 ...Machinist C (Experienced Machinist) US-VA-Newport News Job ID: 34895 Type: Full-Time # of Openings: 1 Category: Tool Manufacturing Canon Virginia, Inc. About the Role Accompany us as we continue this insightful expedition at Canon Virginia Inc...