Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Principal Software Engineer - C++
Job Title Principal Software Engineer - Program Analysis for AI Overview We are looking for an experienced software engineer to help us build a new generation of transpilation tools enabled by AI and modern verification techniques that promises to bridge the gap between algorithm development and deployment to embedded systems. In this role you will play a lead role in architecting and implementing novel code generation pipelines that use a mix of Generative AI, Static Analysis and Formal Verification methods to translate code written in one language to another. Requirements Responsibilities ● Define Software Architecture for Agentic AI pipelines. ● Build well tested extensible code foundations for code translation products. ● Collaborate with domain specialists to incorporate formal verification and static analysis methods into code generation pipeline. ● Collaborate with the software engineering and research teams to build robust code repositories and continuous integration processes. Must Have ● Seven or more years of experience with collaborative enterprise-level software development in C++ to deliver products to a large customer base ● Demonstrated experience gathering requirements from stakeholders and distilling them into software designs ● Demonstrated experience planning and executing on large projects in a team-based setting ● Demonstrated history of building and delivering robust software by employing best practices throughout the SDLC process, including Code review, Testing, Continuous integration, Release management and Build systems Great to Have ● Experience with Compiler development - experience with Clang, LLVM ● Experience with advanced software verification techniques like fuzzing and/or formal verification ● Python experience ● Experience with ML Tools and Frameworks ● Experience working with embedded, heterogeneous (FPGA and/or GPU), and/or distributed systems
Boston, MA, USA
Negotiable Salary
Craigslist
Technical Engineer Level 2 - C1S-MS-094 (SJ)
About Cloud 1 Solutions, Inc. Cloud 1 Solutions is a privately owned corporation founded on 15+ years of Fortune 500 experience supporting rapid growth, emerging technologies, and secure, stable, scalable systems. Our clients range from medical to super high-tech companies with staff located throughout the US and worldwide. Why work at Cloud 1 Solutions? At Cloud 1 Solutions, you will work with some of the most exciting companies in Silicon Valley. Our customers provide services to Tesla, DOD, and DOE. In addition, we deliver critical services for cutting edge firms that range from software development to manufacturing. If you enjoy working in a very dynamic, fast paced, exciting environment, we are the right choice for you. This position is located in San Jose area. Position Description This role will be responsible for engineering and maintaining solutions for the Client Technology infrastructure, support and implementation while providing expert-level operational support. Job Description * The ability/willingness to take on new and unknown applications. * Monitoring and leading project deliverables for both local and remote site and user initiatives. * Collaborate and communicate with client and corporate team members. * Regularly attend meetings at various times to accommodate variances of team. * Ability to deliver informative, well-organized, strategic presentations, with strong interpersonal skills, to build professional relationships, creating partnerships across the organization. * Create and maintain documentation including process procedures, technical specifications, project plans, project schedules, meeting agendas and status reports as needed. * Provide timely and informative status reports to key stakeholders at all levels when appropriate * Be able to work with, and manage vendors when required. * Ability to think creatively or "out of the box" when providing solutions for end users productivity. * Be an enthusiastic advocate for team goals; provide high level support to technical teams (L2) regarding business requirements and deliverables as needed. * Communicate with management and subject matter experts across the organization to accomplish objectives. Required Skills & Requirements Environment: DELL, HP, IBM, MAC, Windows Server, Redhat 6.4 Linux, SAN, NAS, NetApp, EquaLogic Network: LAN/WAN/VLAN, T1, SIP, TCP/IP, VPN, FTP, VMAX, Clarion, EMC, CISCO, Meraki, SonicWALL, DELL, APCON, FCOE, AP, HPE Application: MS Office, SharePoint, Sage, VNC, WebEx, MS Visio, MS Project, Acronis, VMware, Virtual PC, EDR, QuickBooks, EDI, App/Web servers Cyber Security: SIEM, Vulnerability Management, Compliance, ISO, NIST, DFARS, Cyber Insurance * Past experience as a Seasoned Systems Administrator; in a large enterprise environment. * Demonstrated track record of successfully planning participating in large / complex project implementations from start to finish and complete the needed documentation for ongoing support. * Successfully led multi-vendor projects, with end to end technical leadership and management. * Extensive knowledge of Windows platform, both Windows and Server OS. * Positive personality and inclined to be successful while continually improving individual skills and those of the teams. * Self-motivational mindset, able to work with minimal supervision while delivering top-notch solutions that will continue to take the organization to the next level. * Ability to communicate to upper management effectively when needed. * Know when/how to drive change within team and larger IT teams. * Capacity to work varied hours when needed. * Demonstrated operational discipline and thoroughness in most/all aspects of work -- e.g., status reporting, documentation, following process and procedure. * Demonstrated ability to plan and work to an identified set of priorities. Education or Qualifications * Bachelor's degree, or equivalent and demonstrable training and experience. Appropriate technical certifications are a plus. * Ten (10) or more years' experience as a full-time technical professional. * Excellent oral and written communication skills. * Proven ability to direct technical projects. * Extensive experience in the analysis and design of systems, as well as in troubleshooting and providing technical support for these systems. Benefits include Medical, Dental, Vision and 401k! Principals only. Recruiters, please don't contact this job poster.
424 N 9th St, San Jose, CA 95112, USA
Negotiable Salary
Workable
SAP Payroll Technical
We are seeking a highly skilled Payroll Technical Consultant with extensive experience in US Payroll. The ideal candidate will have a strong background in ABAP HR code development and a deep understanding of Core HR and Payroll modules. This role involves designing and developing custom HR-ABAP programs, working with PNP/PNPCE logical databases, and enhancing payroll processes. • Experience: 9-15 years in payroll technical consulting. • ABAP HR Development: Proficient in ABAP HR code development. • Custom Programs: Design and write HR-ABAP custom programs; modify standard programs as needed. • Database Programming: Experience with PNP/PNPCE logical databases and cluster programming for Core HR, payroll, and time management. • Core HR & Payroll Knowledge: In-depth knowledge of Core HR and Payroll modules, including schemas, functions, and operations. • HR Tables/Clusters: Familiarity with HR, Core HR, and Payroll tables/clusters; experience in developing reports/BDC in the HR module. • Payroll Processes: Strong experience in Core HR and payroll processes, including preparing payroll reports. • Reports & Interfaces: Design and develop reports, interfaces, info types, and enhancements. • Team Development: Guide and develop team members to enhance their technical capabilities and productivity. • Forms Experience: Hands-on experience with SMART forms and HR forms. • User Exits & BAPIs: Proficient in user exits, BADi, and BAPI. • OOPS Concept: Strong understanding of object-oriented programming concepts. • Technical Documentation: Experience in requirement gathering, designing technical documents, unit testing, and code review. • Qualifications: • Bachelor’s degree in computer science, Information Technology, or a related field. • Proven experience in payroll technical consulting with a focus on US Payroll. • Excellent problem-solving skills and attention to detail. Strong communication and interpersonal skills.
Burbank, CA, USA
Negotiable Salary
Craigslist
Experienced Computer Repair Technician
Core Systems, a leader in rugged computer and server solutions for mission-critical defense and industrial applications, is seeking a Computer Repair Technician to join our RMA and repair operations team. This position focuses on diagnosing, troubleshooting, and repairing customer-returned products and Core Systems–built servers. Resume Required. Key Responsibilities Perform diagnostics, troubleshooting, and repair on returned computer systems, servers, and components. Process RMA units through inspection, testing, and documentation. Repair hardware at the system, component, and board level when required. Assist in root cause analysis and corrective action reports for customer returns. Work closely with engineering and production teams to support continuous improvement. Maintain accurate service records and ensure timely turnaround of customer units. Qualifications Proven hands-on experience repairing computer systems, servers, or related IT hardware. Strong knowledge of hardware components (motherboards, CPUs, memory, storage, power supplies, etc.). Experience with diagnostic tools and test equipment. Ability to read schematics and follow technical documentation. Detail-oriented, organized, and able to work under time-sensitive conditions. Previous experience in an RMA/repair environment is a MUST. Familiarity with ruggedized or military/industrial computer systems a plus. What We Offer Competitive pay and benefits package. A chance to work with cutting-edge technology in the defense and industrial markets. Collaborative, supportive team environment. Opportunities for growth and advancement within the company.
13434 Twin Peaks Rd, Poway, CA 92064, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.