Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Front End Engineer
About Us Resonance is building a more sustainable and valuable fashion industry for designers, brands, manufacturers, consumers, and the planet. The company’s AI-powered operating system ONE enables Brands to Design, Sell and Make in that order, empowering designers to operate with no unnecessary inventory—eliminating the financial and environmental burdens of the legacy fashion industry. Headquartered in New York City and Santiago, Dominican Republic, Resonance has partnered with more than 30 brands, including THE KIT and Rebecca Minkoff to create garments that use 97% less dye, 70% less water, and 50% less material than any other fashion brand—and immediately eliminate overproduction. Want to know more? Visit our website and read articles about us. About the Role We’re looking to add a front-end software engineer to our team to report directly to our technical cofounder and CEO, Christian Gheorghe and rapidly build interactive user experiences and interfaces for our brands designing, selling and operating on our self-sufficient digital product ONE. This role engages across product management, platform engineering and design. Individuals in this role supercharge our ability to rapidly ship new experiences and learn from live users. Responsibilities include: Build best in class user experiences for highly visual, creative users across a myriad of functions including: 3D design, e-commerce/channel selling systems, planning tools, and more. Scope, design and lead implementation of technical projects, laying groundwork for early-stage products to iteratively evolve and scale. Ensure UI components and libraries are reliable, secure and accessible. Independently and collaboratively solve UI/UX design problems, including debugging for long term stability. You may be a good fit if the following describes you: You’re a coder, a hacker, an engineer at heart. You like to create something from nothing. You appreciate beautiful, highly opinionated, custom built, user experiences and design systems. You are intensely curious and desire a role where you collaborate with creators, designers and manufacturers. You have love for analog and digital products, from vinyl LPS to beautiful VR applications. Requirements Job Requirements 3+ years of experience developing design systems. Strong foundation in front-end frameworks, design patterns, data structures, storage systems and web services. Proficient in web technologies: React, JavaScript, HTML, CSS, modern package bundlers/task runners and testing tools. Experience with CI/CD pipelines and how to integrate frontend applications in that pipeline. Experience with Webpack, Storybook, GraphQL, and AWS a plus. Able to independently solve UI/UX design problems. Computer Science Background Comfortable with being given clearly-defined goals but full ownership and responsibility for discovering the path to achieve those goals. Ability to succeed in a constantly changing, fast-paced environment. Making mistakes means we are learning, and you welcome actively seeking ways to grow Benefits We offer full benefits (medical, dental, and vision), a competitive salary and equity Resonance Companies is an equal opportunity employer and values diversity in our company. We do not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status, or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.
New York, NY, USA
Negotiable Salary
Workable
Principal Embedded Software Developer (VSE)
We are seeking a highly skilled Principal Software Engineer with extensive experience in Linux-based systems software design, security concepts, development, and testing. The ideal candidate will be responsible for implementing new cyber security features, developing implementation guidance for cyber security controls, and conducting research and development of novel cyber security concepts. Key/Primary Responsibilities • Develop cyber security software for Toyota products. • Operate with minimal oversight to define requirements with stakeholders and design the implementation of new features. • Investigate cyber security controls of processors and microcontrollers and develop Proof-of-Concepts and implementation guidance to suppliers. • Perform research and development of novel cyber security features. • Work with the open-source community to expand cyber security capabilities of existing projects and share new projects that are broadly useful outside of Toyota. • Develop software in accordance with team coding guidelines and industry standards including MISRA, SEI CERT, and AUTOSAR. • Collaborate with CICD teams to add new capabilities to the build and release pipeline and customize pipeline for new projects. • Collaborate with test teams to define testing strategies and assist in automated test development. • Lead internal testing team and provide guidance when regular leadership is unavailable. • Mentor junior and mid-level engineers in software development best practices and provide guidance in their design, implementation, and testing tasks. • Conduct root cause analysis of defects and lead initiatives to improve product quality and testing processes. • Work with a wide range of stakeholders to align on deliverable expectations, deployment timelines, and testing issues. • Facilitate team meetings, including sprint planning, retrospectives, and daily stand-ups, to ensure effective communication and collaboration. • Stay current with industry trends and best practices in embedded systems development, and advocate for their integration into the team’s processes. Requirements 10+ years of experience in embedded systems software development, with a focus on both hardware and software components. Strong understanding of embedded programming languages (e.g., C, C++) and real-time operating systems (RTOS). Experience developing embedded Linux systems, including Linux driver development, BSP integration and customization with tools such as Yocto, and board bring-up. Experience with testing tools and frameworks and developing automated tests. Knowledge of communication protocols (e.g., I2C, SPI, UART) and hardware interfaces. Excellent problem-solving skills and attention to detail. Strong leadership and communication skills, with the ability to motivate and guide team members.     Added Bonus: ·       Experience with embedded security features such as secure boot, TrustZone development, filesystem encryption, etc. ·       Experience developing in compliance with safety and security standards such as MISRA, SEI CERT, and AUTOSAR. ·       OSCP, SANS/GIAC, CISSP, or other related/equivalent certifications. ·       Experience with compliance regulations/laws, security frameworks and standards (e.g., ISO/SAE 21434, NIST, HIPAA, ISO, COBIT, OWASP, ITIL, etc.).   Experience with one or more of the following industries: law enforcement, defense, intelligence community, automotive, manufacturing, software,   Bachelor’s degree or higher, in Computer Science, Engineering or related discipline, or equivalent professional experience   Fluent in Japanese (reading, writing, speaking) for business and technical discussions. 
Plano, TX, USA
Negotiable Salary
Workable
Senior Roblox Developer
Sawhorse Productions is a Los Angeles based, Award winning full-service creative studio turning ideas into unforgettable experiences through captivating branded content, viral social moments, and groundbreaking interactive experiences. We partner with industry-leading brands, artists, and studios such as Walmart, Google, NBCU, Fanatics, Toyota, Pepsi and Alo to deliver industry leading, innovative multi-platform content. At Sawhorse, we believe in fostering a culture of collaboration, creativity, and relentless excellence while shaping the future of digital storytelling. Our releases include: Walmart Discovered - 2024 ADDY Winner Alo Sanctuary Beetlejuice Escape the Afterlife Lamborghini Lanzador Lab - 2024 Telly Winner Elton John’s 'Beyond The Yellow Brick Road' Olivia Rodrigo  Fashion Klossette And numerous digital fashion releases on web3 platforms We are looking for experienced Full Stack Roblox Developers to craft best-in-class, high-fidelity experiences that redefine interactive entertainment. In this role, you’ll work alongside a team of industry pioneers, collaborating with game designers, artists, and engineers to develop immersive, scalable, and engaging gameplay. You’ll leverage the latest Roblox technologies, advanced scripting techniques, and performance optimization strategies to push the platform's boundaries, ensuring seamless cross-platform play across PC, mobile, and console. Requirements Design, develop, and optimize high-quality gameplay experiences: Write clean, efficient, and scalable Luau code that powers immersive Roblox experiences. Work directly with Creative and Product teams: Translate creative vision and KPIs into interactive, engaging, and data-driven gameplay experiences. Take ownership of features: Lead development cycles from concept to execution, ensuring best practices and industry standards are met. Coordinate with clients and stakeholders: Ensure the technical execution of gameplay features aligns with project objectives and branding requirements. Work cross-functionally with designers and engineers: Implement gameplay mechanics, UI/UX features, and interactive elements to enhance user experience. Collaborate with QA and product managers: Troubleshoot, debug, and optimize features for performance, reliability, and scalability across multiple devices. Implement and optimize game systems: Develop custom character controllers, AI behavior, and dynamic game mechanics using Object-Oriented Programming principles. Ensure cross-platform compatibility: Optimize gameplay performance across PC, mobile, and console while maintaining graphical and interactive consistency. Utilize the latest Roblox technologies: Implement StreamingEnabled, MemoryStoreService, and advanced data handling techniques for seamless user experiences. Qualifications A strong candidate for this position should have the following qualities: Proven Roblox development experience: 6-10 years of experience on the Roblox platform, with at least 2+ years of programming in Luau. Advanced proficiency in Roblox Studio & scripting: Expertise with Roblox API, object-oriented programming, CFrame manipulation, UI/UX scripting, and performance optimization. Strong understanding of backend services: Experience with Roblox’s datastore, MemoryStoreService, and efficient data handling techniques. Proficiency in GitHub & Rojo: Comfortable working in team-based environments using version control and collaborative coding workflows. Effective communication skills: Ability to explain technical concepts to both developers and non-technical stakeholders. Ability to work independently and collaboratively: Must be a self-starter with strong time-management skills in a remote, fast-paced setting. Nice To Have's Familiarity with open-source tools: Experience using Nevermore, Maids, Promises, Signals, and other community libraries. Game UX & UI expertise: Ability to design and implement smooth, intuitive user flows within the Roblox platform. Roblox plugin development: Experience creating custom Studio tools or plugins to streamline development workflows. Advanced mathematics & physics programming: A background in vector math, procedural animation, and physics-based interactions. Custom Avatar Rigging & Character Controllers: Experience designing unique character systems and animation pipelines. Interest in Web Development: Familiarity with front-end frameworks, API integrations, and external server communication is a plus. Benefits Hourly Rate: $40 - $60/hr (This is a Freelance position and hours may vary) Flexible, remote-friendly role with occasional in-office collaboration opportunities in Los Angeles. Opportunity to work on cutting-edge gaming projects with a team passionate about interactive entertainment. Collaborate with top-tier gaming and entertainment brands. This freelance position is hourly but general work hours are M - F 9:00 AM - 7:00 PM PST. Top performers will have the opportunities to move to full time if everyone is aligned.  EEO Statement Sawhorse Productions is an equal employment opportunity employer. All employees and applicants are evaluated on the basis of their qualifications, consistent with applicable state and federal laws. In addition, Sawhorse Productions will provide reasonable accommodations for qualified individuals with disabilities. Sawhorse Productions will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of applicable state and federal law.
Los Angeles, CA, USA
$40-60
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.