DMV IT Service
Freeport, ME 04032, USA
Job Title: Data Engineer Location: Remote Employment Type: Full-Time About Us: DMV IT Service LLC is a trusted IT consulting firm founded in 2020. We specialize in optimizing IT infrastructure and providing expert guidance to empower businesses to achieve their technology goals. Our services span system administration, cybersecurity, networking, and IT operations. With a client-first approach, we ensure long-term success for our clients through innovative solutions and industry best practices. Position Purpose: We are seeking a Data Engineer to implement data ingestion and pipeline processes on Google Cloud Platform (GCP). This role will focus on designing, developing, configuring, testing, debugging, and documenting complex data workflows and pipelines based on business and technical requirements. You will work both independently and collaboratively with your team to ensure efficient data processing, while adhering to industry standards and best practices. Requirements Data Ingestion & Pipeline Development: Design and implement data ingestion and pipeline workflows according to business needs and technical specifications on Google Cloud Platform. Develop and implement solutions through code development and tool configuration. Collaboration & Communication: Work collaboratively with cross-functional teams, ensuring clear communication and proper tracking of project goals. Prepare detailed specifications and documentation for the development of data pipelines. Provide technical expertise to support teams throughout project phases. Database Management & Querying: Query databases using SQL (Structured Query Language) to extract and manipulate data for analysis and troubleshooting. Support integration with Google BigQuery, Google Cloud Storage, Cloud Composer, and other relevant platforms. Testing & Quality Assurance: Develop and execute testing and implementation plans, performing unit, system, integration, and user acceptance testing (UAT). Document results and ensure high-quality code and data integrity. Project Planning & Reporting: Participate in project planning and development or manage small projects. Estimate the time required to complete work and track project progress for budgeting and financial tracking. Review solution designs, configurations, and code to ensure adherence to best practices. Security & Compliance: Adhere to security standards for processing and storing sensitive data to ensure data security and compliance. Continuous Improvement: Stay informed about new tools, technologies, and practices to improve the quality and efficiency of data workflows and pipeline processes. Required Skills & Experience: Must Have: Experience with Google Pub/Sub, BigQuery, Google Dataform, Google Cloud Storage, and Cloud Composer. Strong SQL skills for querying and managing databases. Proficiency in GitHub for version control. Good to Have: Familiarity with Cloud Data Fusion and experience with DBMS connectivity and interactions (SQL Server, DB2, Oracle). Experience with RESTful APIs and SOAP Web services. Experience integrating with Google resources, databases, and cloud services. Familiarity with project management and collaboration tools such as Jira and Confluence. Qualifications: Education Level: A 4-year Bachelor’s Degree in Computer Science, Information Systems, or related fields, or equivalent work experience. Experience: 3+ years of professional experience in data engineering or a related role with a focus on cloud technologies.