Browse
···
Log in / Register

Senior Big Data Engineer

Negotiable Salary

Qode

North Carolina, USA

Favourites
Share

Description

Role Description: Senior Big Data Engineer – Scala/Spark Location: [Charlotte NC/NY/NJ/or Onsite/Hybrid] Type: [Full-time] Experience Level: Senior level only   Role Overview We are looking for a highly skilled Senior Big Data Engineer with strong expertise in Scala and Apache Spark to support our data engineering team. The ideal candidate should be able to read and refactor existing Scala Spark code, develop enhancements, create robust unit tests, and help migrate code into a modern cloud-native environment.   Key Responsibilities: Analyze and refactor existing Scala Spark code to support migration to new environments. Write and enhance Scala Spark code with a focus on performance and maintainability. Develop comprehensive unit tests to ensure code quality and stability. Work with data stored in Amazon S3 (CSV and Parquet formats). Integrate and manipulate data from MongoDB. Independently set up environments to validate and test code changes. Execute both manual and automated testing procedures. Collaborate within an Agile team and contribute to sprint planning, story grooming, and reviews. Maintain clear and proactive communication with team members, project managers, and stakeholders. Technical Skills & Qualifications: Proficiency in Scala and Apache Spark for large-scale data processing. Working knowledge of Python for scripting and data transformation. Hands-on experience with Amazon Web Services (AWS), including: S3 AWS Glue Step Functions Experience working with MongoDB and structured/unstructured data. Familiarity with SQL and BDD frameworks. Experience with Terraform for infrastructure-as-code is a plus. Strong understanding of software development lifecycle (SDLC), from development to production deployment. Experience using tools like Git, Azure DevOps/TFS, and JIRA. Comfortable working in Agile/Scrum environments. Core Technologies: Scala Spark AWS Glue AWS Step Functions Maven Terraform Soft Skills: Strong problem-solving abilities and attention to detail. Ability to work independently and as part of a collaborative Agile team. Excellent written and verbal communication skills.

Source:  workable View Original Post

Location
North Carolina, USA
Show Map

workable

You may also like

iSoftTek Solutions Inc
Senior Software Engineer
Edmond, OK, USA
Senior Software Engineer Job Type: C2C Duration: Long Term Location: Edmond, OK What You’ll Do ●       Develop organizational software for using the appropriate tools and techniques for each platform in span of care. ●       Review and test existing code-base or technical integrations for various projects. ●       Provide support to other Client Engineers by reviewing, testing, and approving code/software development. ●       Collaborate with various teams and team members to determine the technical approach and to organize development plans. ●       Evaluate the complexity of tasks and provide realistic estimates on the level of effort and completion time. ●       Partner with junior and mid-level engineers to offer training and guidance on best practices. ●       Help ensure that other engineers are moving in the same technical direction. ●       Maintain strategic outlook to plan for future development of processes and team. ●       Provide technical support on escalated software issues. ●       Research industry best practices and new technologies or tools that could be implemented at Life.Church. Skills Needed To Succeed ●       Proficient in modern web technologies, such as TypeScript, React, and NextJS. ●       Excellent verbal, written, and interpersonal communication skills to maintain relationships and partnerships. ●       Maintain a systematic and organized approach to completing assignments accurately, thoroughly, and timely. ●       Clearly explain complicated and detailed processes in a concise and simple way. ●       Ability to self-motivate, take initiative, make independent decisions, and problem-solve. ●       Ability to collaborate in a team environment and work independently. ●       Ability to maintain composure during stressful situations. ●       Own technical design for projects and understand, and articulate, the trade-offs in creating high-quality software. ●       High School Diploma or GED. ●       Bachelor’s degree in computer science preferred. ●       4+ years of related work experience.    
Negotiable Salary
Apex Informatics
Esri ArcGIS Developer
Atlanta, GA, USA
Job Summary: The Georgia Dept. of Transportation (GDOT) is seeking a technical GIS developer for configuring and developing custom Esri ArcGIS Enterprise 10x, 11x (Javascript API, Experience Builder, ArcGIS Portal/Online/Hub, Field Maps) applications. Applications are deployed within SharePoint web sites. Custom GIS solutions will be integrated within .NET based applications, GDOT databases (Oracle/Oracle Exadata, SQL Server), data warehouse (Oracle Exadata), and enterprise reporting (Oracle Business Intelligence Enterprise Edition (OBIEE), Data Visualizer, or Power BI). The candidate will have application programming/development, implementation, and support experience. Under broad supervision, the candidate will design, code, test, modify, and debugs computer software and applications utilizing Esri ArcGIS. The candidate will research and analyze program or systems problems, provides resolutions, and complete system documentation. The candidate will translate business requirements/user stories into development activities in secure, commented, and maintainable code.  The candidate will be working in the Enterprise GIS Team of the Office of IT Applications. The candidate will work with supporting IT team members (database, network, server, etc.) and interact with management, architects, developers, and business units. The candidate will follow internal SLDC, standards/guidelines, and accepted best practices for developing solutions. The Enterprise GIS team is composed of 2 ArcGIS developers, 2 System Administrators, a data manager, and team leader. The team supports over 180 ArcGIS Desktop users and approximately 60,000 annual ArcGIS Server web visits. Applications support GIS portal, feature mapping, project planning, emergency operations, permitting, safety, and traffic records. The team develops enterprise GIS services, applications, and databases. The team coordinates with client, server, network, and database/data warehouse personnel to support and develop the underlying IT solutions. NOTE: While the intent may be a long-term tenure, this position is subject to annual budget restrictions.  The initial contract is through the end of this fiscal year and is anticipated to be renewed July 1, 2025.  Responsibilities: Develops customized web applications, webservices, mobile, and enterprise solutions Develops geoprocessing and GIS web services Develops GIS web editing/mapping applications Conducts performance, unit, system, integration, and quality assurance testing of applications Maintains existing applications/services Upgrades and migrates existing applications/services to current version/systems architecture Provides end user support and creates support documentation Works closely with other developers and architects Estimates work effort and proposes/designs development solutions Work Terms and Conditions: 8 Hour workdays on a fixed schedule (i.e. not a flex-schedule), starting no earlier than 7:00AM Eastern Time, starting no later than 9:00AM Eastern Time, Monday - Friday, 40 hours per week GDOT has NOT specified a number of days onsite vs remote. However, local candidates (i.e. able to come in office) will be preferred over an out of state candidates (i.e. remote worker). GDOT prefers candidates who can demonstrate they have the capability to work a hybrid work schedule which is a combination of remote and in-office work. Candidate capacity (i.e. days they could come into the office) to work a hybrid work schedule will be discussed during interviews. The consultant will follow all applicable State of Georgia and GDOT policies, procedures, standards, guidelines, and accepted best practices. The position end date is set for the end of the GDOT Fiscal Year. GDOT may exercise the option to renew contracts in one-year increments. Several successful consultants have continued working for several years with contract extensions. However, GDOT is under no obligation to extend contracts and may terminate employment at any time. When teleworking or working remotely, consultant must have suitable internet connection and environment to comply with GDOT telework policies. GDOT will reimburse authorized travel expense lodging and meals. GDOT will reimburse authorized travel use of a personal vehicle. Any travel expenses to start work or relocate to Georgia or will not be reimbursed. All travel expense reimbursement shall be in accordance with State Accounting Office Travel Policy: https://sao.georgia.gov/travel/state-travel-policy The Department has 13 holidays, which consultants are not allowed to work nor make up any time for those holiday weeks without management's approval. Consultants are not to take extended leave during their first year of service (e.g. greater than 1week). Consultant must have cell phone which can be used for business calls. GDOT does not provide free parking. All routine commuting expenses are the responsibility of the consultant.
Negotiable Salary
Resource Management Concepts, Inc.
EDM Master Applications Developer
Quantico, VA 22134, USA
**This position is contingent on contract award** RMC is seeking a highly skilled Master Applications Developer to serve as the EDM Technical Lead for the United States Marine Corps Cyberspace Operations Group (MCCOG) in Quantico, VA. This role is critical in supporting the technical, engineering, operations, maintenance, and management functions that ensure the security and effectiveness of the Marine Corps Enterprise Network (MCEN). The MCEN supports over 200,000 users globally, operating behind NIPRNET and SIPRNET boundaries, and includes a complex suite of enterprise virtual server infrastructure, storage area networks, and messaging environments.   Key Responsibilities   Lead and mentor senior technical teams operating in a geographically distributed, classified network environment supporting over 200,000 users. Oversee the engineering, deployment, and maintenance of enterprise-level Active Directory, Microsoft Exchange, SAN, and Virtualization environments. Provide technical leadership for the design, integration, and management of firewalls, routers, switches, VPN devices, and enterprise virtual server infrastructure. Engineer and manage enterprise NetApp storage and VMware virtualization solutions. Utilize Microsoft System Center to automate and optimize critical operational tasks. Ensure compliance with cybersecurity best practices and maintain a tightly integrated, agile, defensible, and survivable network supporting both distributed operations and business enterprise needs. Collaborate with stakeholders to analyze user needs, troubleshoot technical issues, and implement innovative solutions. Guide and supervise system modifications, conduct security audits, and ensure the continuous improvement of network operations. Maintain documentation and provide regular assessments, maintenance, and enhancements of existing applications and infrastructure. Serve as the subject matter expert for enterprise network operations and contribute to strategic planning and risk management. Requirements Minimum seven (7) years of experience leading senior technicians in a geographically distributed, classified network environment. At least five (5) years of experience supporting enterprise-level Active Directory, Microsoft Exchange, SAN, and Virtualization environments. Information Assurance Technical (IAT) Level III certification. AZ-800/801 or M365 Enterprise Admin certification TS/SCI security clearance. ITIL v4 Foundation Certification. Demonstrated experience supporting enterprise network environments with at least 200,000 users. Proven expertise in engineering and managing enterprise NetApp storage and VMware solutions. Desired Skills   Strong technical leadership and mentoring abilities. Excellent problem-solving skills and the ability to innovate under pressure. Exceptional communication and interpersonal skills for effective collaboration with both technical and non-technical stakeholders. Commitment to continuous learning and staying current with industry trends and emerging technologies. Ability to manage multiple priorities in a fast-paced, mission-critical environment.   Benefits At RMC, we're committed to your career growth! RMC differentiates itself from other firms through its investment in our employees. We invest our resources to train, certify, educate, and build our employees. RMC can offer you a great place to work with a small company feel and give you the experience and certifications that will take your career to the next level. RMC also offers high-quality, low-deductible healthcare plans and a competitive 401K package. * Salary at RMC is determined by various factors, including but not limited to location, a candidate's specific combination of education, knowledge, skills, competencies, and experience, as well as contract-specific requirements. The current salary range for this position will be $140,000.00 to $174,000.00 annually.
$140,000-174,000
Avalore, LLC
Software Engineer, Skill Level 3
Fort Meade, MD, USA
At Avalore, we are a mission-driven, veteran-owned small business that helps government agencies harness the power of data and emerging technologies to solve complex problems. Our team combines deep technical expertise with a passion for public service, delivering innovative, responsible solutions in AI, data governance, cybersecurity, and enterprise transformation. Joining Avalore means working alongside experts who have successfully led high-impact initiatives across the DoD and Intelligence Community, and being part of a company that values integrity, agility, and purpose. Your responsibilities will include: Develops, maintains, and enhances complex and diverse software systems (e.g., processing-intensive analytics, novel algorithm development, manipulation of extremely large data sets, real-time systems, and business management information systems) based upon documented requirements.  Analyze user requirements to derive software design and performance requirements  Design and code new software or modify existing software to add new features  Debug existing software and correct defects  Integrate existing software into new or modified systems or operating environments  Develop simple to complex data queries for existing or proposed databases or data repositories  Provide recommendations for improving documentation and software development process standards  Works individually or as part of a team.  Reviews and tests software components for adherence to the design requirements and documents test results.  Utilizes software development and software design methodologies appropriate to the development environment.  Provides specific input to the software components of system design to include hardware/software trade-offs, software reuse, use of Commercial Off-the-shelf (COTS)/Government Off-the-shelf (GOTS) in place of new development, and requirements analysis and synthesis from system level to individual software components. Requirements Bachelor’s degree in a technical discipline from an accredited college or university is required + Twenty (20) years’ experience as a SWE in programs and contracts of similar scope, type, and complexity  Four (4) years of relevant SWE experience may be substituted for the degree   Five (5) years of experience leading and managing technical project tasks.   Experience applying agile development while maintaining smart and effective sprint cycles meeting timely deliverables.  Ability to work independently and manage multiple priorities. TS/SCI and Special Security Accesses and Polygraph required. Applicants must be currently authorized to work in the United States on a full-time basis. Avalore will not sponsor applicants for work visas for this position. Desired: Cloud, CNO, DevOps, Data Analytics, Machine Learning & AI  Benefits Eligibility requirements apply. Health Care Plan (Medical, Dental & Vision) Retirement Plan (401k, IRA) Life Insurance (Basic, Voluntary & AD&D) Paid Time Off (Vacation, Sick & Public Holidays) Short Term & Long Term Disability Training & Development Employee Assistance Program
Negotiable Salary
Mindrift
Freelance Software Developer (Rust) - AI Trainer
Michigan, USA
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as an AI Tutor in Coding, you’ll have the opportunity to collaborate on these projects.  Although every project is unique, you might typically: Generate prompts that challenge AI. Define comprehensive scoring criteria to evaluate the accuracy of the AI’s answers. Correct the model’s responses based on your domain-specific knowledge. How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in Software Development, Computer Science, or other related fields.  You have at least 3 years of professional experience with Rust. Code review experience is a must. Experience with AI projects is a plus. Your level of English is advanced (C1) or above. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
$50
Mindrift
Freelance Software Developer (Rust) - AI Trainer
Michigan, USA
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and achieving complex reasoning skills. If you join the platform as an AI Tutor in Coding, you’ll have the opportunity to collaborate on these projects.  Although every project is unique, you might typically: Generate prompts that challenge AI. Define comprehensive scoring criteria to evaluate the accuracy of the AI’s answers. Correct the model’s responses based on your domain-specific knowledge. How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in Software Development, Computer Science, or other related fields.  You have at least 3 years of professional experience with Rust. Code review experience is a must. Experience with AI projects is a plus. Your level of English is advanced (C1) or above. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
$50
Cookie
Cookie Settings
© 2025 Servanan International Pte. Ltd.