Browse
···
Log in / Register

Senior Big Data Engineer

Negotiable Salary

Qode

North Carolina, USA

Favourites
Share

Description

Role Description: Senior Big Data Engineer – Scala/Spark Location: [Charlotte NC/NY/NJ/or Onsite/Hybrid] Type: [Full-time] Experience Level: Senior level only   Role Overview We are looking for a highly skilled Senior Big Data Engineer with strong expertise in Scala and Apache Spark to support our data engineering team. The ideal candidate should be able to read and refactor existing Scala Spark code, develop enhancements, create robust unit tests, and help migrate code into a modern cloud-native environment.   Key Responsibilities: Analyze and refactor existing Scala Spark code to support migration to new environments. Write and enhance Scala Spark code with a focus on performance and maintainability. Develop comprehensive unit tests to ensure code quality and stability. Work with data stored in Amazon S3 (CSV and Parquet formats). Integrate and manipulate data from MongoDB. Independently set up environments to validate and test code changes. Execute both manual and automated testing procedures. Collaborate within an Agile team and contribute to sprint planning, story grooming, and reviews. Maintain clear and proactive communication with team members, project managers, and stakeholders. Technical Skills & Qualifications: Proficiency in Scala and Apache Spark for large-scale data processing. Working knowledge of Python for scripting and data transformation. Hands-on experience with Amazon Web Services (AWS), including: S3 AWS Glue Step Functions Experience working with MongoDB and structured/unstructured data. Familiarity with SQL and BDD frameworks. Experience with Terraform for infrastructure-as-code is a plus. Strong understanding of software development lifecycle (SDLC), from development to production deployment. Experience using tools like Git, Azure DevOps/TFS, and JIRA. Comfortable working in Agile/Scrum environments. Core Technologies: Scala Spark AWS Glue AWS Step Functions Maven Terraform Soft Skills: Strong problem-solving abilities and attention to detail. Ability to work independently and as part of a collaborative Agile team. Excellent written and verbal communication skills.

Source:  workable View Original Post

Location
North Carolina, USA
Show Map

workable

You may also like

iSoftTek Solutions Inc
.NET API Specialist
Dallas, TX, USA
Role: .NET API Specialist Location: Dallas, TX(4 days onsite)- . Yrs of exp:10+   Your responsibilities in this role will include: Lead the design, development, and implementation of robust and scalable .NET Core APIs. Hands-on Knowledge on SQL queries Collaborate with cross-functional teams to gather requirements and architect solutions. Hands-on coding and debugging of API components to ensure high performance and reliability. Mentor junior developers and provide technical guidance and support. Stay current with industry trends and best practices, particularly in cloud technologies. Extensive experience in developing .NET APIs using C#. Strong proficiency in cloud platforms such as AWS, Azure, or Google Cloud Platform. Demonstrated expertise in designing and implementing RESTful APIs. Solid understanding of software development methodologies and practices. Excellent communication skills and ability to collaborate effectively with teams. Knowledge of microservices architecture. Familiarity with DevOps practices and tools.   Requirements: Bachelor’s degree in computer science, Engineering, or a related field. Proven experience as a .NET/C# Developer with a minimum of 8 years in software development. Strong proficiency in C#, ASP.NET, and the .NET Framework. Solid understanding of software development principles and best practices. Good in database systems (Oracle RDBMS, etc.). Excellent problem-solving and communication skills. Ability to work independently and collaboratively within a team. Primary skills:  SQL NET API AZURE AWS KUBERNETES ORACLE RDBMS KAFKA DOCKER KUBERNETES CI/CD PIPELINE C#
Negotiable Salary
Fawkes IDM
Elite Applications Engineer
Hackensack, NJ, USA
Seeking a full-time Enterprise Applications Engineer for an on-site role. This person will be responsible for administration, monitoring and maintenance of the Accounting enterprise applications. Responsibilities: Administer and support the Firm's Elite 3E platform Serves as the subject matter expert and technical resource for the Firm’s financial system both within the financial group and the IT department by providing expertise on issues of functionality, integration, performance/troubleshooting, design, deployment etc. Administer all other systems in the Firm’s financial platform including various supporting systems in the 3E Elite application and tools including (but not limited to) Paperless Performa, IDE, Design Gallery (EDG), Workspace. Responsible for the administration and support tasks related to the Elite 3E system. This can include but is not limited to: Scheduled month-end maintenance Upgrades to 3E, Workspace, and other related software systems Coordinate with database and application administrators on projects which are related to the financial system Responsible for development deliverables of Elite 3E customizations (forms, inquiries, reports, metrics, etc.) with quality and consistent integration between key financial applications and Document customization solutions. Analyze and work with the Financial team users and IT team on the impact of vendor software upgrades Coordinates with both the Accounting and IT team, to prioritize and address issues and objectives for financial systems Responsible for testing financial system applications during system changes, enhancements, upgrades and monthly system maintenance, as well as, documentation of system integrations, backup and disaster recovery processes Project Management - create, track and update all Elite 3E customization and new project tasks. Work closely with the Accounting team to deliver strategic projects Informs the department and management in a timely manner of project status, issues and proposed resolutions. Manage vendor support tickets Track and optimize system performance and storage utilization, plan for necessary hardware or software upgrades to support system growth Research and evaluate new technologies to improve current application processes. Utilize tools to protect application source code, and maintain versioning. Requirements 3+ years’ experience operating with legal accounting and time management software required, experience with Elite 3E preferred Experience with maintaining Proforma Tracker, 3E Templates, 3E Workspace and BizTalk. Proficiency in Elite Application Framework and Tools, including the IDE, Design Gallery (EDG) Experience administering Windows Server Intermediate to advanced knowledge of SQL Application installation and configuration experience Fluency in the Elite 3E SQL database schema preferred or demonstrated ability to develop such fluency 5+ years’ experience in the management, design and implementation of Windows computer systems. Experience administering and maintaining Microsoft SQL and MS Active Directory is desirable. Experience with iManage document management administration, Thomson Reuters 3e Accounting management systems and Foundations system administration preferred. Microsoft Certified Systems Engineer (MCSE) preferred, but not required.
Negotiable Salary
Axiom Software Solutions Limited
TIBCO Developer
Jackson, MS, USA
Role: TIBCO Developer Location: Jackson MI -  Hybrid mode Position Type: Contract   We are seeking a TIBCO Developer to join the integration team supporting Consumers Energy in Jackson, MI. The ideal candidate will have strong expertise in TIBCO Business  Works 6.x and a solid understanding of enterprise integration patterns.   Responsibilities:   ·       Design, develop, and support integration solutions using TIBCO BusinessWorks 6.x and 5.x, TIBCO EMS, API development and TIBCO BusinessEvents. ·       Develop and maintain APIs using TIBCO API Exchange, including RESTful and SOAP web services ·       Configure and monitor messaging using TIBCO EMS, Hawk, and Rendezvous ·       Collaborate with business analysts, architects, and other developers to deliver high-quality integration solutions ·       Troubleshoot and resolve production issues in a timely manner ·       Participate in code reviews and deployment processes ·       Ensure integration components adhere to security, performance, and scalability standards   Required Qualifications:   ·       5+ years of hands-on experience with: ·       TIBCO BusinessWorks (BW) 6.x and 5.x ·       TIBCO EMS, Hawk, BusinessEvents ·       TIBCO Rendezvous and API Exchange Gateway ·       Solid understanding of SOA and integration architecture ·       Experience with RESTful and SOAP APIs ·       Familiarity with DevOps, CI/CD pipelines, and Git-based versioning ·       Strong debugging and troubleshooting skills in enterprise environments ·       Ability to work independently in a hybrid/remote setup ·       Strong verbal and written communication skills   Nice to Have:   ·       Knowledge of Containers (Docker/Kubernetes) and Cloud platforms (Azure or AWS) ·       Experience with other integration technologies or scripting languages ·       Prior experience working in utility or energy sectors   Note: they need BW and BE development skills, not just one or the other, can good comminication skills, clear english, I am also asking if they are willing to relocate to Jackson Mi, along with API development  
Negotiable Salary
Cookie
Cookie Settings
© 2025 Servanan International Pte. Ltd.