Browse
···
Log in / Register

Senior Big Data Engineer

Negotiable Salary

Qode

New York, NY, USA

Favourites
Share

Description

Role Description: Senior Big Data Engineer – Scala/Spark Location: [CLT/NY/NJ/or Remote/Hybrid] Type: [Full-time/Contract] Experience Level: Senior level only   Role Overview We are looking for a highly skilled Senior Big Data Engineer with strong expertise in Scala and Apache Spark to support our data engineering team. The ideal candidate should be able to read and refactor existing Scala Spark code, develop enhancements, create robust unit tests, and help migrate code into a modern cloud-native environment.   Key Responsibilities: Analyze and refactor existing Scala Spark code to support migration to new environments. Write and enhance Scala Spark code with a focus on performance and maintainability. Develop comprehensive unit tests to ensure code quality and stability. Work with data stored in Amazon S3 (CSV and Parquet formats). Integrate and manipulate data from MongoDB. Independently set up environments to validate and test code changes. Execute both manual and automated testing procedures. Collaborate within an Agile team and contribute to sprint planning, story grooming, and reviews. Maintain clear and proactive communication with team members, project managers, and stakeholders. Technical Skills & Qualifications: Proficiency in Scala and Apache Spark for large-scale data processing. Working knowledge of Python for scripting and data transformation. Hands-on experience with Amazon Web Services (AWS), including: S3 AWS Glue Step Functions Experience working with MongoDB and structured/unstructured data. Familiarity with SQL and BDD frameworks. Experience with Terraform for infrastructure-as-code is a plus. Strong understanding of software development lifecycle (SDLC), from development to production deployment. Experience using tools like Git, Azure DevOps/TFS, and JIRA. Comfortable working in Agile/Scrum environments. Core Technologies: Scala Spark AWS Glue AWS Step Functions Maven Terraform Soft Skills: Strong problem-solving abilities and attention to detail. Ability to work independently and as part of a collaborative Agile team. Excellent written and verbal communication skills.

Source:  workable View Original Post

Location
New York, NY, USA
Show Map

workable

You may also like

Workable
Data Engineer III
Seattle, WA, USA
Position: Data Engineer III  Location: Seattle, WA 98121  Duration: 17 Months        Job Type: Contract          Work Type:  Onsite        Job Description:      The Infrastructure Automation team is responsible for delivering the software that powers our infrastructure.  Responsibilities  As a Data Engineer you will be working in one of the world's largest and most complex data warehouse environments.  You will be developing and supporting the analytic technologies that give our customers timely, flexible and structured access to their data.  Design, build, and maintain scalable, reliable, and reusable data pipelines and infrastructure that support analytics, reporting, and strategic decision-making  You will be responsible for designing and implementing a platform using third-party and in-house reporting tools, modeling metadata, building reports and dashboards  You will work with business customers in understanding the business requirements and implementing solutions to support analytical and reporting needs.  Explore source systems, data flows, and business processes to uncover opportunities, ensure data accuracy and completeness, and drive improvements in data quality and usability.  Required Skills & Experience  7+ years of related experience.  Experience with data modeling, warehousing and building ETL pipelines  Strong experience with SQL  Experience in at least one modern scripting or programming language, such as Python, Java.  Strong analytical skills, with the ability to translate business requirements into technical data solutions.  Excellent communication skills, with the ability to collaborate across technical and business teams.  A good candidate can partner with business owners directly to understand their requirements and provide data which can help them observe patterns and spot anomalies.   Preferred  Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions  Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)  3+ years of reparation of data for direct use in visualization tools like Tableau experience  KPI: Meet requirements, how they action solutions, etc.:  Leadership Principles:   Deliver Results  Dive Deep  Top 3 must-have hard skills  Strong experience with SQL  Experience in at least one modern scripting or programming language, such as Python, Java.  Experience with data modeling, warehousing and building ETL pipelines 
Negotiable Salary
Workable
Freelance Software Developer (Ruby) - Quality Assurance (AI Trainer)
Colorado, USA
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as an AI Tutor in Coding, you’ll have the opportunity to collaborate on these projects. Although every project is unique, you might typically: Code generation and code review Prompt evaluation and complex data annotation Training and evaluation of large language models Benchmarking and agent-based code execution in sandboxed environments Working across multiple programming languages (Python, JavaScript/TypeScript, Rust, SQL, etc.) Adapting guidelines for new domains and use cases Collaborating with project leads, solution engineers, and supply managers on complex or experimental projects How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's in Software Development, Computer Science, or other related fields.  You have at least 3 years of professional experience with Ruby, hands-on experience with Ruby testing frameworks (RSpec, Minitest, Capybara) and automation tools Experience using, integrating, or tutoring others with AI/ML or LLM-powered testing/coding solutions in Ruby projects. Code review experience is a must. Hackathon or competitive coding experience is a plus. Your level of English is advanced (C1) or above. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
Negotiable Salary
Craigslist
SECURITY ALARM INSTALLATION TECHNICIAN - Technician I (Honolulu, HI)
346 S King St, Honolulu, HI 96813, USA
ZMANA Smart Security Solutions is looking for a part, to full time residential/light commercial Alarm Installation Technician on Oahu. The applicant should possess great customer service skills, be adaptive to new innovations and technology, and have knowledge of electrical security systems.   We are a fun and passionate company and excited to offer a quality product and an outstanding customer experience every time. If you share the same passion, and want to work in a new company driven by entrepreneurship and excellent service please submit your resume! SUMMARY:  Install the customer’s residential and/or light commercial security system; including alarm systems, surveillance cameras, compatible door locks, and various other devices incorporated into the customer’s security system. Communicate with the team regarding schedule and availability for installs. Communicate with the customer about the installation of their new or upgraded system and have the ability to fully walk them through that system’s physical attributes and backend capabilities. KNOWLEDGE AND SKILLS: Must have knowledge of equipment application, programming, connection and performance testing of the system, and programming. Must have a knowledge of intrusion detection, including CCTV. Must have general computer skills. Preferable knowledge of Z-Wave and Z-Wave devices. Should possess a Professional attitude. Great interpersonal skills and customer service skills. As all of our systems are custom designed for each customer, applicant should be able to adjust to a changing environment and be able to communicate professionally with the customer. This job involves working with around 120 Volt electricity. This position involves potentially being on a ladder, being in attics, crawling underneath houses, and being in tight places. High School Diploma or GED. 2 years minimum alarm industry installation technician experience.  Please email resume for review. Please apply online with ZMANA at: https://zmana.prismhr-hire.com/job/197222/security-alarm-installation-technician-technician-i?s=cl
$18-30/hour
Workable
Globality BID- .NET Python Full Stack DeveloperWLK TX
Roanoke, TX, USA
Job Title: .NET Python Full Stack Developer  Location: Roanoke, TX Employment Type: Contract About Us:  DMV IT Service LLC is a trusted IT consulting firm, established in 2020. We specialize in optimizing IT infrastructure, providing expert guidance, and supporting workforce needs with top-tier staffing services. Our expertise spans system administration, cybersecurity, networking, and IT operations. We empower our clients to achieve their technology goals with a client-focused approach that includes online training and job placements, fostering long-term IT success. Job Purpose: The developer will focus on building robust RESTful APIs and backend systems using .NET, Python, and Java technologies. This includes writing clean and maintainable code, participating in architecture discussions, and ensuring seamless integration and performance of distributed systems. The role also involves contributing to cloud deployments and supporting continuous integration and delivery pipelines. Requirements Key Responsibilities Design, build, and maintain RESTful APIs using Java, integrated into a microservices environment Develop scalable backend systems using .NET and Python Collaborate with product owners, QA, and other developers to gather requirements and translate them into technical solutions Build and maintain web applications using Angular, JavaScript/TypeScript, Node.js, HTML, and CSS Work within Agile (SCRUM) teams to deliver high-quality features and enhancements Utilize Azure and AWS cloud platforms for hosting and deploying services Participate in DevOps practices, including CI/CD pipeline maintenance and automation Perform unit testing and integration testing to ensure code reliability Write clean, reusable, and well-documented code in line with industry best practices Maintain version control using tools like Git Create and maintain technical documentation for developed services Required Skills & Experience 5+ years of experience in application development and data engineering Proficient in backend development using .NET and Python Strong experience developing APIs using Java (preferably with Spring Boot) Hands-on experience with frontend technologies such as Angular, JavaScript/TypeScript, Node, HTML, and CSS Solid understanding of REST API architecture and secure design principles Experience with Azure and/or AWS cloud services Proficiency in SQL and working with relational databases like PostgreSQL or MySQL Strong skills in version control tools such as Git Experience with DevOps, CI/CD pipelines, and automated deployment practices Familiarity with Agile methodologies (Scrum) Background in financial services is a plus Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.