Browse
···
Log in / Register

Senior Big Data Engineer

Negotiable Salary

Qode

New York, NY, USA

Favourites
Share

Description

Role Description: Senior Big Data Engineer – Scala/Spark Location: [CLT/NY/NJ/or Remote/Hybrid] Type: [Full-time/Contract] Experience Level: Senior level only   Role Overview We are looking for a highly skilled Senior Big Data Engineer with strong expertise in Scala and Apache Spark to support our data engineering team. The ideal candidate should be able to read and refactor existing Scala Spark code, develop enhancements, create robust unit tests, and help migrate code into a modern cloud-native environment.   Key Responsibilities: Analyze and refactor existing Scala Spark code to support migration to new environments. Write and enhance Scala Spark code with a focus on performance and maintainability. Develop comprehensive unit tests to ensure code quality and stability. Work with data stored in Amazon S3 (CSV and Parquet formats). Integrate and manipulate data from MongoDB. Independently set up environments to validate and test code changes. Execute both manual and automated testing procedures. Collaborate within an Agile team and contribute to sprint planning, story grooming, and reviews. Maintain clear and proactive communication with team members, project managers, and stakeholders. Technical Skills & Qualifications: Proficiency in Scala and Apache Spark for large-scale data processing. Working knowledge of Python for scripting and data transformation. Hands-on experience with Amazon Web Services (AWS), including: S3 AWS Glue Step Functions Experience working with MongoDB and structured/unstructured data. Familiarity with SQL and BDD frameworks. Experience with Terraform for infrastructure-as-code is a plus. Strong understanding of software development lifecycle (SDLC), from development to production deployment. Experience using tools like Git, Azure DevOps/TFS, and JIRA. Comfortable working in Agile/Scrum environments. Core Technologies: Scala Spark AWS Glue AWS Step Functions Maven Terraform Soft Skills: Strong problem-solving abilities and attention to detail. Ability to work independently and as part of a collaborative Agile team. Excellent written and verbal communication skills.

Source:  workable View Original Post

Location
New York, NY, USA
Show Map

workable

You may also like

Craigslist
Business Systems Analyst (SAP S4HANA HCM Functional Support) JO#6506 (downtown / civic / van ness)
455 Golden Gate Ave, San Francisco, CA 94102, USA
JOB TITLE: Business Systems Analyst (SAP S4HANA HCM Functional Support) LOCATION: San Francisco or Sacramento JOB OPENING #: 6506 OVERVIEW The Judicial Council of California is accepting applications for the position of Business Systems Analyst (BSA) in the Trial Court Administrative Services (TCAS) Center of Excellence Human Resources Payroll System Support (HR PSS) unit of the Branch Accounting and Procurement (BAP) office. The Business Systems Analyst provides system and software maintenance support for the Phoenix SAP system to end users in the Trial Court Administrative Services’ (TCAS) Shared Services Center and the trial courts. This includes support of the Organizational Management, Personnel Administration, Benefit Administration, Time Management, and Payroll modules, and Employee Services and Manager Services Fiori applications, for twenty courts currently utilizing the HR Payroll services. The Phoenix SAP System was recently upgraded to SAP S4HANA version 2023 with HCM4HANA. The Judicial Council strives for work life balance and includes substantial vacation and holiday time. In addition, we offer an excellent benefits package including pension, medical, dental and vision coverage, flexible spending, up to $130 per month reimbursement for qualifying commuting costs, and retirement savings plans. In San Francisco, the office is only a 7-minute walk from the downtown Civic Center BART station. In Sacramento, the office is located minutes from downtown, just north of Discovery Park. The Judicial Council The Judicial Council of California is the policymaking body for the state court system and has constitutionally conferred statewide rule-making authority. This authority includes developing, advocating for, and allocating the judicial branch budget. A majority of Council members are California state justices and judges; however, the Council also includes lawyers, legislators, and court administrators. By enhancing its role as a leadership, knowledge, and service resource for the judicial branch, the Judicial Council’s staff organization seeks to continue to evolve as one of California’s most dynamic public service entities, focused on improving access to justice for all Californians by innovating and responding to the changing needs of the courts and the public. As a government body charged with improving the statewide administration of justice, the Judicial Council has multiple offices with diverse responsibilities relating to court policy and operations. As employees of the council, every member of staff should view and approach their work as one Judicial Council with a public service mission that is greater than the sum of its parts. The Judicial Council offers hybrid work arrangements for many positions. The successful candidate will be expected to work in person at the Judicial Council’s San Francisco or Sacramento office at least two days per week, based on their office leader’s direction, and reside in the areas surrounding these locations. RESPONSIBILITIES • Provide essential SAP system module support and maintenance in areas or modules of Organizational Management, Personnel Administration, Benefit Administration, Time Management, Payroll, Employee Services, and Manager Services for the end users in TCAS Shared Services and the trial courts working on mostly standard less complex items such as master data table changes. o Assess and analyze system issues by communicating with the reporting users, reviewing system or other authoritative documentation, and performing system validation to determine full understanding of the problem and root cause, as needed. o Gather and document all business requirements and conduct interviews/workshops and design and update requirement and configuration templates as needed. • Under the direction and guidance of the Manager and with support of a Sr. BSA, review, analyze, develop, and execute on-going system maintenance to ensure tables and schemas are designed and running at optimal system performance. o Perform changes and complete comprehensive testing in the Phoenix sandbox environment. Repeat until successful prototype results are achieved. o Implement (design, build or configure, test, and document) the solution using the Phoenix Change Request Management (ChaRM) process. • Participate in the review, analysis, and execution of SAP year-end support packs as a module expert. o Review, analyze, and document SAP notes that should be tested or that can be part of general automated testing process using Variance Monitor (VM). o Attend project meetings and business team meetings to provide updates on the status of work. • Under the direction and guidance of the Manager and with support of a Sr. BSA, participate in SAP system upgrades. o Review, analyze, and document system changes of an assigned module to assist in the tasks needed to complete the project plan. o Attend project meetings and business team meetings to provide updates on the status of work. • Assist in training and/or knowledge transfer to users of the system, peer analysts, and office colleagues. o Review and analyze subject matter to ensure complete understanding of what is to be documented and trained. o Develop, create, and maintain documentation using existing program templates to align solution design, process flow, system and manual steps, decision points, and impacts. Collaborate with peers and key users. Gain approval through existing program review process. MINIMUM QUALIFICATIONS EDUCATION AND EXPERIENCE Bachelor’s degree and three (3) years of experience providing technical and business process support and analysis for systems/applications. An additional four (4) years of professional experience as noted above may substitute for the bachelor’s degree. Or, additional directly related experience and/or education may be substituted on a year-for-year basis. OR Three (3) years as a Business Systems Coordinator, or two (2) years as an Associate Analyst in the assigned field with the Judicial Council of California, or three (3) years of experience performing the duties of a class comparable in the level of responsibility to that of a Business Systems Coordinator, or two (2) years as an Associate Analyst in the assigned field in a California superior court or California state-level government entity. Desirable Qualifications • Strong knowledge of SAP HR/Payroll (USA Public Sector), Personnel Administration (PA), Employee Services (ES), Manager Services (MS), Taxes, W2, Benefits Administration (BA), Organization Management (OM), or other relevant experience to solve business problems in support of the Phoenix SAP system. • Experience with SAP HR/Payroll systems including functional configuration and design, integration with third-party systems, testing, and support. • Hands-on experience performing configuration and testing on at least 2 US Payroll implementations. OTHER Please note, if you are selected for hire, verification of employment authorization to work in the United States will be required. HOW TO APPLY This position is Open Until Filled. Submission of our official application, a resume and a response to the supplemental questions is required. To ensure consideration of your application for the earliest round of interviews, please apply by 5:00 P.M. on Tuesday, September 30, 2025. To complete the online application, please visit https://www.courts.ca.gov/careers.htm and search for JO# 6506. The Judicial Council provides reasonable accommodation to applicants with disabilities who request such accommodation. Reasonable accommodation needs should be requested through Human Resources at (415) 865-4260. PAYMENT & BENEFITS $7,513 - $11,270 per month Please note due to statewide fiscal conditions, the posted salary range is subject to a temporary 3% reduction. In exchange for this reduction, judicial branch employees accrue an additional 5 hours of paid personal leave per month through June 30, 2027. Some highlights of our benefits package include: • Health/Dental/Vision benefits program • 14 paid holidays per calendar year • Choice of Annual Leave or Sick/Vacation Leave • 1 personal holiday per year • Up to $130 per month reimbursement for qualifying commuting costs • CalPERS Retirement Plan • 401(k) and 457 deferred compensation plans • Employee Assistance Program • Basic Life and AD&D Insurance • FlexElect Program • Pretax Parking • Long Term Disability Program (employee paid/optional) • Group Legal Plan (employee paid/optional) The Judicial Council of California Is an Equal Opportunity Employer Supplemental Questions for Business Systems Analyst (JO# 6506) To better assess the qualifications of each applicant, we will review your response to the following question. Please indicate for which employer you performed these functions. Your answer should not exceed a total of one page. 1. Please explain why you are interested in this position. 1832 2. Please explain your functional experience supporting SAP HR Payroll or other ERP system(s). 4072
$7,513-11,270/month
Craigslist
Automation and Controls Engineer (PLC Programmer)
1405 Primrose Ln, Minden, NV 89423, USA
New Logic manufactures and sells industrial filtration equipment that uses polymeric membranes to provide specific separations. Mostly, this involves filtering water or wastewater for industrial use. The filtration systems are fully automated and are controlled by a programmable Logic Controller (PLC). These systems run autonomously and are monitored by an operator. The systems include pumps, pneumatic valves, instrumentation, and speed controllers for all the motors. Interested customers will send a small sample amount of liquid for testing at New Logic’s research lab. If the initial feasibility is verified, testing is normally continued on a larger scale at the customer’s facility. After pilot testing, the customer may place an order for a large system that would go into fabrication. We have an opening for an automation and controls person who can create, edit, and test Allen Bradley and/or Siemens control software. The work would include dialogue with the customer and probable integration with their existing plant controls. We currently use Auto-Cad, Inventor, Graphite, Adobe Illustrator, Excel, Allen Bradley, Siemens, and other software programs. During final wet testing of the system, the automation program is loaded and then thoroughly tested to make sure all the sub-routines are functioning correctly. The work may involve some travel for commissioning. Job Requirements are: PLC ladder logic programming skills Drafting Software experience Ability to relocate to Minden Nevada Self motivation and desire to learn Good organizational analytical skills New Logic Research has been installing its VSEP membrane filtration systems since 1987. Our system is uniquely capable of filtration of practically any type liquid/solid separation. The technology employs a patented vibration process that reduces membrane fouling and allows for membrane filtration of feed streams containing very high amount of suspended solids, organic matter, oil & fat, and other materials that would blind off other membrane systems. New Logic has installed projects on all continents. Our success has come from our small company entrepreneur spirit and encouragement of ideas and self-motivation from our employees. New Logic has competitive pay packages and benefits.
Negotiable Salary
Workable
Freelance Software Developer (Python Engineer) - AI Trainer
Texas, USA
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What we do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role We are looking for an experienced Python developer who enjoys building tools, environments, and infrastructure for working with LLM-based agents. You’ll help create sandboxes, task systems, and CI/CD pipelines to support testing and development of AI agents. You’ll also work closely with researchers and domain experts, helping them set up and use these tools effectively. Although every project is unique, you might typically: Sandboxes for running and testing AI agents safely Tools for writing tasks and test cases for agents CI/CD pipelines to run checks and evaluate agents Dev environments for experts creating these tasks Repo templates and scripts to help new contributors Interfaces for tracking task input and agent results Example Tasks How to get started Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone. Requirements You have a Bachelor's or Master’s degree in Software Development, Computer Science, or other related fields.  You have 5+ years of experience writing Python code. Your level of English is advanced (C1) or above. You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines. Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge. Benefits Why this freelance opportunity might be a great fit for you? Get paid for your expertise, with rates that can go up to $50/hour depending on your skills, experience, and project needs. Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments. Work on advanced AI projects and gain valuable experience that enhances your portfolio. Influence how future AI models understand and communicate in your field of expertise.
$50
Craigslist
Manager – Application Development (Anderson Main Office) (Anderson)
19563 Fairwind Dr, Anderson, CA 96007, USA
We train and promote from within Excellent low-cost health benefits Retirement plan with employer-paid contributions Paid vacation and 10 holidays At Sierra Pacific Industries, we understand our greatest strength is the people who choose to build a career with us. We are a fourth-generation family-owned company that has grown to be one of the largest lumber and millwork producers in the United States. Our more than 6,000 employees are proud to work at our state-of-the-art sawmills and other facilities, including: manufacturing, custom wood-framed windows, fabrication, millwork, veneer, cogeneration, trucking, forestry, and other operations. We are seeking an experienced Application Development Manager to direct our IT team based at our main office in Anderson, California. This position is not remote and requires living in the surrounding areas. The successful applicant requires current authorization to work in the United States as Sierra Pacific does not provide a Visa sponsorship. Sierra Pacific is a family-oriented company where employees are respected, integrity is valued, and a strong work ethic is recognized and rewarded. We seek qualified IT professionals to become a valued members of our IT team that takes pride in effectively responding to business needs and directly contributing to the success of the company. About the Position Manage, motivate, and effectively supervise a team of Application Developers on the IBM i (Power Systems) platform Effectively discern user and business needs, translate those needs to actionable requirements, and communicate realistic expectations Engage with team members and end users to solicit collaboration, facilitate productivity, and clarify program intent Identify and schedule work to meet company priorities and goals Partner with other IT department managers to coordinate project activities and promote a team environment Utilize business and technology experience to solve problems and innovate diverse software solutions Provide technical support, mentorship, training, and cross-training for team members Collaborate, maintain heightened awareness, and ensure commitment to support of all security and compliance requirements and cyber response plans Effectively communicate with both technical and non-technical audiences of various levels within the Company Participate in staffing decisions Test, troubleshoot, and program as needed Qualifications Bachelor’s Degree in Software Engineering, Application Development, or related Computer Science program 3 years’ project lead or management/supervisory experience 5 years’ experience with RPG IV / ILE RPG in a business environment Demonstrated leadership, motivation, and interpersonal skills to foster positive relationships Experience in manufacturing and wood products is highly preferred Demonstrated sense of urgency and commitment to achieve efficient and accurate results Independently motivated, detail-oriented, and able to maintain focus on long-term projects Proven problem-solving and time-management skills Committed to the highest levels of integrity and ability to maintain confidentiality Why Join Our Team? Because this is more than an invitation, it's a commitment to offer opportunities for personal and professional growth to everyone! We ask people to grow with us and make the company even better. We provide an excellent benefit package including a full Health Benefits Plan (including medical, dental, and vision) with low-cost premiums, a 401(k) with Company Match, additional Retirement Contributions, and company-paid Life Insurance. How to Apply If you are qualified and would like to join our team, please send a cover letter referencing this position and a resume to: Sierra Pacific Industries Human Resources PO Box 496011 Redding, CA 96049 (866) 378-8001 or apply online and view all our career opportunities at: spi.careers Sierra Pacific is an (EOE) Equal Opportunity Employer, including those with a disability and veterans. The general wage range for this position at Sierra Pacific Industries is from $135,000 to $195,000 per year, and is dependent upon a number of factors, including, but not limited to: relevant work experience, skill, knowledge, and/or education. About Our Company Sierra Pacific Industries is a fourth-generation family-owned company based in Northern California that started in 1949 and has grown to be one of the largest lumber and millwork producers in the U.S., employing around 6,500 crew members. Sierra Pacific continues to be a company where its employees are proud to work at state-of-the-art facilities and others strive to become part of the team. We own and sustainably manage more than 2.4 million acres of timberland in California, Oregon, and Washington. Our forests are sustainably managed under a 100-year plan by Registered Professional Foresters, Wildlife Biologists, Botanists, and other professionals. We are growing forests for our future, planting over 6 million new trees every year. In Spring 2024, we planted our 300 millionth seedling on our timberlands. This milestone was decades in the making, reflecting our commitment to sustainable forest management and ensuring we have forests not just for today, but for generations to come. Sierra Pacific effectively uses nearly 100% of every piece of wood we bring to our facilities. In fact, any small amount that isn't turned into hand-crafted doors and windows, millwork, lumber, or landscaping material is actually converted into electricity in our eight biomass-fueled power plants. We are proud that all Sierra Pacific facilities follow our drug-free and tobacco-free policies. As part of our safety in the workplace policy, an offer of employment is subject to a negative drug screen result. We use E-verify to verify the social security number and work authorization of all newly hired employees. Sierra Pacific is an (EOE) Equal Opportunity Employer, including those with a disability and veterans.
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.