Browse
···
Log in / Register

Senior Big Data Engineer

Negotiable Salary

Qode

North Carolina, USA

Favourites
Share

Description

Role Description: Senior Big Data Engineer – Scala/Spark Location: [Charlotte NC/NY/NJ/or Onsite/Hybrid] Type: [Full-time] Experience Level: Senior level only   Role Overview We are looking for a highly skilled Senior Big Data Engineer with strong expertise in Scala and Apache Spark to support our data engineering team. The ideal candidate should be able to read and refactor existing Scala Spark code, develop enhancements, create robust unit tests, and help migrate code into a modern cloud-native environment.   Key Responsibilities: Analyze and refactor existing Scala Spark code to support migration to new environments. Write and enhance Scala Spark code with a focus on performance and maintainability. Develop comprehensive unit tests to ensure code quality and stability. Work with data stored in Amazon S3 (CSV and Parquet formats). Integrate and manipulate data from MongoDB. Independently set up environments to validate and test code changes. Execute both manual and automated testing procedures. Collaborate within an Agile team and contribute to sprint planning, story grooming, and reviews. Maintain clear and proactive communication with team members, project managers, and stakeholders. Technical Skills & Qualifications: Proficiency in Scala and Apache Spark for large-scale data processing. Working knowledge of Python for scripting and data transformation. Hands-on experience with Amazon Web Services (AWS), including: S3 AWS Glue Step Functions Experience working with MongoDB and structured/unstructured data. Familiarity with SQL and BDD frameworks. Experience with Terraform for infrastructure-as-code is a plus. Strong understanding of software development lifecycle (SDLC), from development to production deployment. Experience using tools like Git, Azure DevOps/TFS, and JIRA. Comfortable working in Agile/Scrum environments. Core Technologies: Scala Spark AWS Glue AWS Step Functions Maven Terraform Soft Skills: Strong problem-solving abilities and attention to detail. Ability to work independently and as part of a collaborative Agile team. Excellent written and verbal communication skills.

Source:  workable View Original Post

Location
North Carolina, USA
Show Map

workable

You may also like

Workable
Freelance Software Developer (Rust) - Quality Assurance (AI Trainer)
N 1st St, Brooklyn, NY, USA
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as an AI Tutor in Coding, you’ll have the opportunity to collaborate on these projects. Although every project is unique, you might typically: Code generation and code review Prompt evaluation and complex data annotation Training and evaluation of large language models Benchmarking and agent-based code execution in sandboxed environments Working across multiple programming languages (Python, JavaScript/TypeScript, Rust, SQL, etc.) Adapting guidelines for new domains and use cases Following project-specific rubrics and requirements Collaborating with project leads, solution engineers, and supply managers on complex or experimental projects How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's degree in Computer Science, Software Engineering, or related field. You have at least 3 years of professional experience with Rust and hands-on experience with Rust testing tools (e.g., cargo test, property-based testing with quickcheck). Familiarity with Rust tooling (Cargo, Clippy, rustfmt), module and crate management. Experience with code review, quality analysis, and identifying/fixing code smells and type issues⁠ Familiar with test integration in CI/CD environments. Experience using, integrating, or tutoring others with AI solutions or LLMs in Rust/test automation contexts. Your level of English is advanced (C1) or above. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
$50
Workable
BDD Developer
California, USA
Job Summary:   We are looking for a highly motivated BDD Writer with strong experience in writing use cases and feature files using Behavior-Driven Development (BDD) methodologies. The ideal candidate will also possess hands-on experience with Python-based BDD frameworks such as Behave or pytest-bdd to support automated testing and collaborative specification of business requirements.   Key Responsibilities: Collaborate with product owners, business analysts, and QA teams to understand business requirements. Write clear and concise BDD scenarios in Gherkin syntax (Given-When-Then format). Create and maintain feature files for multiple use cases. Support development and QA teams in implementing step definitions and test automation in Python. Ensure feature files are well-aligned with user stories and acceptance criteria. Participate in grooming and planning sessions to ensure proper coverage of scenarios. Assist in maintaining a structured and scalable BDD repository.   Required Skills & Qualifications: 3+ years of experience in writing BDD use cases and feature files. Proficient in Python with exposure to BDD frameworks like Behave, pytest-bdd, or lettuce. Strong understanding of Gherkin language and behavior-driven development principles. Familiarity with Agile/Scrum methodologies. Excellent communication skills and ability to work closely with cross-functional teams. Strong attention to detail and a mindset for quality and precision.   Preferred Qualifications: Experience in test automation and integrating BDD with CI/CD pipelines. Exposure to test management tools like Jira, TestRail, or Zephyr. Background in financial services or enterprise-scale applications is a plus.
Negotiable Salary
Craigslist
Cyber Security Engineer - Entry Level with Training!
909 Colorado St, Austin, TX 78701, USA
Join Northstar Technologies Where Problem-Solvers Grow Northstar Technologies is looking for individuals who bring more than just technical know-how. We value energy, initiative, and a curiosity to tackle challenges. Whether you’re starting out or have some experience, we provide opportunities to grow your IT career and make an impact. Why Choose Northstar? We focus on developing talent. Our 3-month remote training program equips you with hands-on learning using advanced equipment in our data center. You’ll also receive mentorship from Senior Engineers to guide you throughout your training. What We Offer • Accelerated Learning: Complete our training in 3 months or faster, depending on your pace. • Mentorship:Learn directly from experienced engineers committed to your growth. • Modern Tools and Tech: Get hands-on with industry-leading equipment. • Opportunities: Competitive pay with clear paths for raises. • Travel Perks: Company-sponsored travel with weekly stipends for those open to new locations. After training, you’ll be eligible for a full-time position starting at $22/hr. Comprehensive Benefits Full-time employees enjoy benefits including: Medical, Dental, Vision, Life insurance and Paid PTO/ Holidays Who We’re Looking For Ideal candidates bring: • Problem-solving skills: You tackle challenges directly and seek new solutions. • A Willingness to Learn: You’re adaptable and eager to gain new skills. • A Team-Oriented Mindset: You value collaboration and open communication. • Attention to Detail: You’re organized and thorough. • Practical Thinking: You approach problems with an open mind and resourcefulness. Requirements: • Ability to pass a background check and drug screen. • Willingness to travel or relocate temporarily (with company support). • Authorization to work in the U.S. Ready to Move Forward? Send your resume to info@northstar-tek.com and start your journey with Northstar Technologies. We help businesses transform through technology, providing secure, agile, and cloud-ready IT infrastructure solutions. Our services range from strategy and consulting to design, implementation, and support.
$22/hour
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.