Browse
···
Log in / Register

Senior Big Data Engineer

Negotiable Salary

Qode

New York, NY, USA

Favourites
Share

Description

Role Description: Senior Big Data Engineer – Scala/Spark Location: [CLT/NY/NJ/or Remote/Hybrid] Type: [Full-time/Contract] Experience Level: Senior level only   Role Overview We are looking for a highly skilled Senior Big Data Engineer with strong expertise in Scala and Apache Spark to support our data engineering team. The ideal candidate should be able to read and refactor existing Scala Spark code, develop enhancements, create robust unit tests, and help migrate code into a modern cloud-native environment.   Key Responsibilities: Analyze and refactor existing Scala Spark code to support migration to new environments. Write and enhance Scala Spark code with a focus on performance and maintainability. Develop comprehensive unit tests to ensure code quality and stability. Work with data stored in Amazon S3 (CSV and Parquet formats). Integrate and manipulate data from MongoDB. Independently set up environments to validate and test code changes. Execute both manual and automated testing procedures. Collaborate within an Agile team and contribute to sprint planning, story grooming, and reviews. Maintain clear and proactive communication with team members, project managers, and stakeholders. Technical Skills & Qualifications: Proficiency in Scala and Apache Spark for large-scale data processing. Working knowledge of Python for scripting and data transformation. Hands-on experience with Amazon Web Services (AWS), including: S3 AWS Glue Step Functions Experience working with MongoDB and structured/unstructured data. Familiarity with SQL and BDD frameworks. Experience with Terraform for infrastructure-as-code is a plus. Strong understanding of software development lifecycle (SDLC), from development to production deployment. Experience using tools like Git, Azure DevOps/TFS, and JIRA. Comfortable working in Agile/Scrum environments. Core Technologies: Scala Spark AWS Glue AWS Step Functions Maven Terraform Soft Skills: Strong problem-solving abilities and attention to detail. Ability to work independently and as part of a collaborative Agile team. Excellent written and verbal communication skills.

Source:  workable View Original Post

Location
New York, NY, USA
Show Map

workable

You may also like

Workable
Software Dev Engineer IV
Herndon, VA 20170, USA
Job Title: Software Dev Engineer IV Location: Herndon, VA, 20171 Duration: 6 Months       Job Type: Contract         Work Type: Hybrid   Job Description:  Design, develop, implement, test, document and deploy full-stack, cloud-native, contact center-related software applications, tools, systems and services using multi-threaded programming, development in Python and React/node.js, implementing architecture patterns and design patterns, and utilizing generative AI large language models. Assist in gathering and analyzing business and functional requirements, and translate requirements into technical specifications for robust, scalable, supportable solutions that work well within the overall system architecture. Own delivery of entire piece of system or application, and serve as technical lead on complex projects using best practice engineering standards. Produce comprehensive, usable software documentation. Qualifications: MS or BS in Computer Science, Computer or Electrical Engineering, Mathematics, or a related field, plus five years of progressively responsible experience in the job offered or related occupations of Software Engineer, Software Developer, or related. Required technical skills: Coding proficiency in Python, and front-end development experience with Javascript/React. Proficiency development with services such as AWS Lambda, Step Functions, DynamoDB, AppSync, Bedrock, SageMaker, and CloudWatch. Proficiency in developing and integrating with REST-based or GraphQL-based APIs. Proficiency in developing infrastructure-as-code deployment solutions such as AWS CloudFormation or AWS CDK . Experience collaborating with other developers using git repositories, including creating and managing feature branches, pull requests, code merge, and GitHib actions or equivalent. Preferred skills: Experience with Contact Center development and telephony infrastructure. Experience with prompt engineering for modern large language models. Experience using modern AI-based agentic coding assistants for code development, test development, and documentation. Track record of building successful serverless architectures following AWS Well Architected principles. Candidate Requirements:  Years of Experience: 5+ Years Degree or Certification: Bachelors’ degree preferred Top 3 must-have hard skills:  Generative AI based coding AWS serverless Python and JavaScript/React Required: 5+ years-* Python Developer,  Javascript/React, AWS, (Gen AI/ AI / ML/ MLops / etc..,) Only Hybrid 
Negotiable Salary
Workable
Software Engineer 1 - AWS
Hanover, MD 21076, USA
The Software Engineer develops, maintains, and enhances complex and diverse software systems (e.g., processing-intensive analytics, novel algorithm development, manipulation of extremely large data sets, real-time systems, and business management information systems) based upon documented requirements. Works individually or as part of a team. Reviews and tests software components for adherence to the design requirements and documents test results. Resolves software problem reports. Utilizes software development and software design methodologies appropriate to the development environment. Provides specific input to the software components of system design to include hardware/software trade-offs, software reuse, use of Commercial Off-the-shelf (COTS)/Government Off-the-shelf (GOTS) in place of new development, and requirements analysis and synthesis from system level to individual software components. Requirements Be proficient in Java, javascript, SQl, linux, Git, Maven, Desired skills: AWS, UI development, Spring Framework, MongoDB, Elasticsearch, Postgres, Lucerne Query Language (Elasticsearch) Analyze user requirements to derive software design and performance requirements Design and code new software or modify existing software to add new features Debug existing software and correct defects Integrate existing software into new or modified systems or operating environments Develop simple data queries for existing or proposed databases or data repositories Provide recommendations for improving documentation and software development process standards Develop or implement algorithms to meet or exceed system performance and functional standards Assist with developing and executing test procedures for software components Write or review software and system documentation Develop software solutions by analyzing system performance standards, confer with users or system engineers; analyze systems flow, data usage and work processes; and investigate problem areas Serve as team lead at the level appropriate to the software development process being used on any particular project Modify existing software to correct errors, to adapt to new hardware, or to improve its performance Design, develop and modify software systems, using scientific analysis and mathematical models to predict and measure outcome and consequences of design Design or implement complex database or data repository interfaces/queries Qualifications: Seven (7) years experience as a SWE, in programs and contracts of similar scope, type, and complexity is required. Bachelor’s degree in Computer Science or related discipline from an accredited college or university is required. Four (4) years of additional SWE experience on projects with similar software processes may be substituted for a bachelor’s degree. Position requires active Security Clearance with appropriate Polygraph Benefits Health Care Plan (Medical, Dental & Vision) Retirement Plan (401k, IRA) Life Insurance (Basic, Voluntary & AD&D) Short Term & Long Term Disability Free Food & Snacks
Negotiable Salary
Craigslist
Tier II Technical Support
465 E 34th St, Brooklyn, NY 11203, USA
Brooklyn Low Voltage Supply is a national wholesale distributor of technology products serving professional installation companies. We are committed to delivering top-quality solutions and timely technical support. As we continue to grow, we are seeking a skilled and motivated Tech Support Agent (Tier II) to join our expanding team. Position Summary: This role is ideal for a technically proficient individual who enjoys problem-solving, customer interaction, and staying current with the latest in low-voltage technology. The position offers significant growth potential for the right candidate. Key Responsibilities: Provide technical support for CCTV systems, intercoms, door phones, access control systems, and alarm panels via phone, email, Zendesk, and remote tools (e.g., TeamViewer) Troubleshoot hardware and software issues for clients, both remotely and occasionally in person Diagnose and test defective or malfunctioning hardware Document all technical support interactions, resolutions, and best practices in internal systems Collaborate with internal teams to escalate and resolve complex technical problems Required Qualifications: Technical background with previous experience or education in IT, electronics, or security systems Strong troubleshooting and diagnostic abilities Ability to learn and adapt to new technologies quickly Excellent organizational skills and attention to detail for documentation Preferred Skills: Familiarity with Microsoft Office for internal communications and reporting Knowledge of computer and IP networking fundamentals Experience with IP camera systems Zendesk or other ticketing system experience Programming experience is a plus (especially scripting for system integration or automation) Training: In-house training is available for qualified candidates who may require additional skill development.
$20-25/hour
Workable
Oracle Data Engineer
Smithfield, RI, USA
Job Title: Oracle Data Engineer  Location: Smithfield, RI  Employment Type: Full-Time About Us:  DMV IT Service LLC is a trusted IT consulting firm, established in 2020. We specialize in optimizing IT infrastructure, providing expert guidance, and supporting workforce needs with top-tier staffing services. Our expertise spans system administration, cybersecurity, networking, and IT operations. We empower our clients to achieve their technology goals with a client-focused approach that includes online training and job placements, fostering long-term IT success. Job Purpose: We are looking for a seasoned Data Engineer with extensive experience in data engineering, relational databases, ETL tools, and legacy system understanding, particularly COBOL. The role demands expertise in SQL, data integration, and data modeling, along with the ability to navigate and debug COBOL code within an enterprise environment. Requirements Key Responsibilities Develop, maintain, and debug complex SQL queries within Oracle databases. Design and implement data integration and movement solutions using ETL tools like Informatica or similar, executed via shell scripting. Understand, read, and validate COBOL and Pro*C code to ensure proper functionality, even if not actively coding in COBOL. Perform shell scripting (K-Shell, Bash) and work proficiently in Linux or AIX environments. Apply strong knowledge of data modeling, domain-driven design, and data structures. Collaborate within DevOps frameworks, supporting CI/CD processes and tools. Work closely with cross-functional teams in Agile environments, following Scrum or Kanban methodologies. Support critical applications with responsiveness and effective troubleshooting. Required Skills & Experience Bachelor’s degree in Computer Science, Engineering, or related technical discipline. 7+ years of experience in data engineering, data warehousing, and analytics technologies. 7+ years working with relational databases, preferably Oracle. Strong expertise in SQL, capable of writing and debugging advanced queries. 5+ years of experience with Informatica or comparable ETL tools for data integration. 5+ years of hands-on shell scripting experience (K-Shell, Bash). Proficiency in Linux or AIX systems. Ability to read and understand COBOL and Pro*C programs, including compiling and executing them. Experience with DevOps principles and CI/CD pipelines. Solid understanding of data modeling and data architecture. Experience working in Agile methodologies like Scrum or Kanban. Strong communication and collaboration skills across technical and business teams. Desired Skills & Experience Experience with Python programming. Familiarity with Apache Tomcat. Experience using BI tools such as OBIEE. Exposure to cloud platforms like AWS or Azure, and orchestration tools like Airflow. Knowledge of CI/CD automation tools. Understanding of the financial services domain.
Negotiable Salary
Craigslist
Tier II Technical Support
465 E 34th St, Brooklyn, NY 11203, USA
Brooklyn Low Voltage Supply is a national wholesale distributor of technology products serving professional installation companies. We are committed to delivering top-quality solutions and timely technical support. As we continue to grow, we are seeking a skilled and motivated Tech Support Agent (Tier II) to join our expanding team. Position Summary: This role is ideal for a technically proficient individual who enjoys problem-solving, customer interaction, and staying current with the latest in low-voltage technology. The position offers significant growth potential for the right candidate. Key Responsibilities: Provide technical support for CCTV systems, intercoms, door phones, access control systems, and alarm panels via phone, email, Zendesk, and remote tools (e.g., TeamViewer) Troubleshoot hardware and software issues for clients, both remotely and occasionally in person Diagnose and test defective or malfunctioning hardware Document all technical support interactions, resolutions, and best practices in internal systems Collaborate with internal teams to escalate and resolve complex technical problems Required Qualifications: Technical background with previous experience or education in IT, electronics, or security systems Strong troubleshooting and diagnostic abilities Ability to learn and adapt to new technologies quickly Excellent organizational skills and attention to detail for documentation Preferred Skills: Familiarity with Microsoft Office for internal communications and reporting Knowledge of computer and IP networking fundamentals Experience with IP camera systems Zendesk or other ticketing system experience Programming experience is a plus (especially scripting for system integration or automation) Training: In-house training is available for qualified candidates who may require additional skill development.
$20-25/hour
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.