Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Software Engineer with Clearance
What is Aviture? Aviture is a full-service technology consulting firm with expertise in software solutions for both commercial and government organizations. We believe software doesn’t mean anything unless it solves a problem, so we create technology to enable users, open possibilities, and create meaningful impact. “I wanted to create a company that I would have wanted to work at when I was an engineer.” — Mark Griffis, President We are headquartered in Omaha, Nebraska, with remote employees across the nation: Las Vegas, Washington D.C., Austin, Dallas, Portland, Green Bay, Kansas City, Madison, Minneapolis, and Orlando, just to name a few. What is Aviture’s Art of the Possible? Along with our mission-driven team’s deep expertise in a wide range of development languages, we employ a disciplined agile approach to define goals upfront, keep organizational value at the forefront, and set the pace for rapid, iterative innovation that transforms organizations. We call this the Art of the Possible. The solutions we’ve created have: Saved lives in the California wildfires and southern U.S. flooding Provided security for the 2020 Presidential Inauguration, Super Bowl, and post-attack Boston Marathon Enabled augmented-reality training environments for surgeons Increased transparency and promoted patient wellness in hospitals and senior care facilities Combined computer vision and robotics to automate dangerous manual labor tasks And much more! Why You’ll Want to Live Aviturian Aviturians create technology that makes a meaningful difference in someone’s life. We’re a team made up of designers, engineers, developers, and inventors who believe technology’s purpose is to empower users to change the world. Here are the values that guide us: Embody integrity Seek ownership Stay hungry Remain grounded Create impact Challenge with respect We’ve built our culture around creativity, continuous learning, and our shared values. If that sounds like something you’d like to be a part of, then join us today! Software Engineer Aviture is hiring a Software Engineer. Aviturians understand how technology can change the world and have the technical skills to make those visions a reality. Aviturians are always eager to learn, share, collaborate, grow, and innovate. (We also share a good meme or thirty.) We’re looking for a rockstar Software Engineer who will… Work with a cross-functional team to design, develop, test and deploy innovative solutions to a wide range of complex business problems. Actively participate in all aspects of our agile development process. Utilize effective debugging techniques to identify and resolve software defects. Continuously keep themselves up to date on changes in technology, with an emphasis on the tech stacks being used by your team. Sound like you? Apply today: Requirements BS degree in Software Engineering related degree, similar technical field of study or equivalent practical experience. Excellent verbal and written communication skills. Able to respectfully challenge the status quo. Experience developing and maintaining large-scale applications using one or more general purpose programming languages, such as:Python, Java, C#/.NET, Go, JavaScript, TypeScript Experience with one or more modern frontend technologies is a plus: ReactJS, AngularJS, VueJS, etc. Able to work both autonomously, as well as collaboratively among a team of your peers. Excellent grasp of computer science concepts, proven ability to solve complex technical problems. Experience using common design patterns in the software industry. High personal standards for code quality, maintainability, and performance. This position will require the employee to have a Secret level Government clearance or the ability to obtain one. This position will require the employee to work in person at an off-site location. Benefits PPO or a High Deductible Health Plan, HSA eligible plan, Dental, Vision, and Supplemental Life. Generous paid time off that starts accruing on day one. Hybrid work environment with quarterly Castaway Week events in the Omaha HQ Office, all expenses paid, from across the country to participate in team-building, collaboration, and fun events. Company vacations!!! Previous destinations have included Napa Valley, Cancun, Cabo San Lucas and Aspen. Matching 401k with 100% vesting in six months. Pick your preferred workstation! Mac? PC? We’ll support you with the tech you need to do your best work. Get paid to go to national and international conferences and training, so that you can stay up to date with the latest innovations. Flexible work schedules: Work the times that fits your schedule, with all meetings required to be scheduled between 9 am and 3 pm CST. Free lunch every Friday and recurring team events for you and your family to enjoy. Incentive and bonus pay. Opportunities for connection and growth through peer coaching, recurring Lightning Talks to share things we’re passionate about, and a bi-weekly company-wide All Hands.
Omaha, NE, USA
Negotiable Salary
Craigslist
Central Ohio Service & Strategy Specialist (Central Ohio)
LINK TO JOB POSTING DOC: https://docs.google.com/document/d/e/2PACX-1vQ2eHIedyLv8bdqmUhvMZsKTb3L-xmmdMtxrG8yd28yhQSX29Q5QA3IbN5befY-zpqFu3rGsq22VIiy/pub -------------------------------------------------------------- CENTRAL OHIO SERVICE & SYSTEMS SPECIALIST – JOB DESCRIPTION POSITION OVERVIEW: We are seeking a highly motivated and experienced Central Ohio Service & Strategy Specialist to serve as BOTH the strategic/organizational leader and on-site project/service leader for the Central Ohio region. This role is the primary standard-bearer for both strategy and on-site delivery, combining leadership responsibilities with hands-on execution. The position requires extensive experience in both leadership/strategy and operational/technical domains. KEY FOCUS AREAS: Develop and execute strategy for client service and internal process improvement Lead and execute projects from scoping to completion Oversee and deliver on-site technology and client-facing service Organize meetings, set agendas, and follow up on action items Design, document, and implement systems and processes Manage internal and external communications, escalations, and planning NECESSARY SOFTWARE KNOWLEDGE: Ticketing & IT Service Management (ConnectWise, ServiceNow, SuperOps, etc.) Documentation & Collaboration (Confluence, SharePoint, Google Workspace, Office 365) Remote Support (TeamViewer, LogMeIn, AnyDesk, Microsoft RDP) Cybersecurity Tools, endpoint protection, MFA, CMMC 2.0 practices a plus Networking & Monitoring (PRTG, SolarWinds, Ubiquiti, Meraki) CRM & Communication (Salesforce, HubSpot, Slack, Teams, Zoom) LOCATION REQUIREMENT: Must be located in Central Ohio Regular on-site client visits throughout Central Ohio; home-based role with travel CORE RESPONSIBILITIES: Design, implement, and maintain operational systems and standardized workflows Develop and document business processes; create process automation where applicable Establish and track metrics/KPIs; lead process improvement (Kaizen, ‘5 Whys’, PSDA, etc.) Initiate regular client updates; create communication schedules and alerts Organize, lead, document, and follow up on meetings and action items Collaborate on escalations; ensure thorough documentation and process follow-through Own project deliverables and tracking from start to finish Provide hands-on technical support during on-site visits (network cabling, equipment moves up to 50+ lbs, etc.) REQUIRED QUALIFICATIONS: Must be based in Central Ohio 5+ years in both leadership/strategy AND operational/technical roles (not entry level) Demonstrated abilities in strategic planning, team leadership, and hands-on delivery Strong understanding of IT systems and business processes Excellent written and verbal communication Able to manage multiple projects, work independently and directly with clients DESIRED QUALIFICATIONS: Experience with process improvement methodologies and project management Technical certifications relevant to IT service delivery Familiarity with automation tools, AI, and operational challenges KEY SUCCESS INDICATORS: Operational systems implemented and maintained successfully Consistent proactive, effective communication Clear meeting outcomes and documentation Reliable completion of projects within timelines High client satisfaction and process ownership OUR COMPANY CULTURE: We lead with kindness, act with honesty, and are committed to always giving our best. Our team thrives on curiosity, creative solutions, and a constant drive to improve – for our clients and each other. COMPENSATION & BENEFITS: $27–$40/hr, part-time (approx. 20-30 hrs/week, 9 a.m. to noon core hours, flexibility required) Full medical, vision, dental 401(k) with 4% company contribution Mileage reimbursement at $0.30/mile for on-site work Growth opportunity in a dynamic, supportive environment HOW TO APPLY: Click link at top to see application info.
Northwest Garage, 271 Ives Dr, Columbus, OH 43210, USA
$27-40/hour
Workable
Senior Embedded System Software Engineer (Communication)
Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint. We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.  Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.  Overview: We are seeking a skilled Senior Embedded Software Engineer to design, develop, and optimize enterprise networking products such as routers, access points and so on. In this hands-on role, you will collaborate closely with cross-functional teams to bring features from concept to completion, ensuring high standards of performance, reliability, and safety. You will be involved in every stage of the product life cycle, including development, manufacture, and maintenance and so on. Key Responsibilities: Design, develop, and maintain software systems for embedded network devices. Design and integrate network solutions into overall architecture and hardware design across multiple platforms Responsible for device driver development and maintenance, such as Flash, Wi-Fi, wired network etc. Design and development of features in the area of L2/Bridging/L3/Routing for the network devices. Implement, maintain, troubleshoot, and improve manufacturing processes, including maintaining flow charts, develop manufacture software, identify and fix issues, and make improvements and so on.  Work closely with hardware team to deliver high quality products. ·Responsible for design and development review of software systems. Responsible for identifying and fixing bugs prior to software release. Write clean, maintainable, and well-documented code. Implement software features of high quality and on schedule. Collaborate seamlessly with cross-functional teams, including designers, product managers, and QA engineers, to deliver unparalleled user experiences. Provide technical leadership, mentorship, and guidance to junior team members, fostering a collaborative and high-performing environment. Conduct meticulous code reviews and provide mentorship to junior developers, ensuring strict adherence to coding standards and industry best practices. Requirements Bachelor’s degree in computer science, Software Engineering, or a related field. Minimum of 5 years of related experience. Proficiency in embedded software programming skills with C/C++ language. Experience with embedded Linux kernel and application development. Experience with audio/video encoding, motor controls software development. Proficiency in ONVIF, RTCP, RTSP application development. Knowledge of network technology including NAT, TCP, UDP, IPv4, IPv6, HTTP etc. Experience in analyzing crash logs, stack trace, faults by utilizing basic debugging techniques Experience with version control systems (e.g., Git). Highly motivated, positive, detail oriented and responsible. Preferred Qualifications: Experience with designing and delivering storage software modules. The storage device may be a TF card, hard disk (SSD/HDD/HHD), NAS, and so on. Deep knowledge of Linux kernel internals (process scheduler, concurrency, synchronization, memory allocation, file systems). Knowledge of wireless communication protocols, e.g. 802.11a/b/g/n/ac/ax/be. Benefits Salary range: $140,000 - $200,000 Free snacks and drinks, and provided lunch on Fridays Fully paid medical, dental, and vision insurance (partial coverage for dependents) Contributions to 401k funds Bi-annual reviews, and annual pay increases Health and wellness benefits, including free gym membership Quarterly team-building events At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.
Irvine, CA, USA
$140,000-200,000/year
Craigslist
Tech Support Representative (Andersonville, Chicago)
Booklog is looking for a level 1 – 3 technical support individual. This position is to provide outstanding technical support for Booklog software and various interfaces along with onboarding of new customers, testing of software and training on usage of software. We’re looking for a motivated individual to be part of our committed team. We need to be the experts so our customers don’t have to. Located in Chicago’s Andersonville neighborhood; telecommuting is available. Qualifications • At least 2 years experience in technical support, preferably phone support • Experience with Microsoft Windows operating systems • Familiarity with databases and database troubleshooting • Knowledge of computer network systems • Ability to troubleshoot software problems and offer solutions by phone • Good problem solving skills with attention to detail • Strong verbal, written, interpersonal, and organizational skills • Ability to work both independently and in a team environment • Experience with SQL Server 2022, Sybase SQL applications and databases • Ability and excitement to learn new skills • A ‘think outside of the box’ mentality • Customer Service experience • Software training experience a plus • Previous experience training customers on software usage • Experience with use of peripheral devices • 10% or less travel to customer locations within the US to train and install software Benefits • Casual environment with a great group of people who love what they do • In office or telecommuting options • 100% paid health insurance • 2 weeks vacation to start • Generous 401K options • Permanent full-time. PLEASE SEND RESUME WHEN APPLYING
5146 N Clark St #1222, Chicago, IL 60640, USA
$50,000/year
Workable
Embedded System Software Engineer (Smart Home)
About Us: Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint. We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology. Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle. Overview: We are seeking a Junior Embedded System Software Engineer (Smart Home) to design, develop, and optimize firmware for smart home products like Smart IP cameras, Smart Doorbells, etc. In this hands-on role, you will work closely with cross-functional teams to take features from concept to completion, ensuring high performance, reliability, and safety. You will be engaged in all stages of the development process, from chipset bring-up and SDK integration to new feature implementation. The software development work typically involves SoC chipsets running Linux and MCU subsystems operating in an RTOS environment. Key Responsibilities: Work with cross-functional teams to define system requirements and design effective solutions for smart home products. Participate in the software development process from initial design through production for TP-Link smart home devices. Write, debug, and test embedded software using C/C++ and other relevant programming languages. Bring up chip SDKs and integrate third-party features using cross-compiling techniques. Design and develop core modules such as audio/video transmission, control, connectivity, networking, and storage for smart home products. Work with Wi-Fi, Bluetooth BR/EDR/BLE protocols, and network stacks such as TCP/IP, Thread, BLE Mesh for diverse use cases. Troubleshoot and resolve complex issues in embedded systems to maintain product performance. Conduct unit tests, integration tests, and system validation. Ensure software meets performance, reliability, and security standards, including protocols to safeguard against vulnerabilities. Optimize code to meet requirements for performance, memory, and power efficiency. Produce technical documentation, including design specifications, software architecture, and user manuals. Work with external vendors and partners to integrate hardware and software components seamlessly. Adapt third-party platform SDKs and develop related use cases, such as Amazon, HomeKit, and Matter. Ensure product readiness for production by developing manufacturing tools, facilitating certifications, and providing on-site support as required. Investigate and address customer-reported issues, implementing firmware updates to enhance performance and resolve issues. Stay updated on trends in embedded systems, IoT, and connectivity protocols to continuously enhance product features and performance. Mentor and guide recent graduates, offering technical leadership and sharing best practices through code reviews and team collaboration. Requirements Required Qualifications: Bachelor's degree in computer science, Electrical Engineering, or a related field. 2+years of experience working with embedded software. Proficiency in embedded software programming using C/C++, with a strong understanding of coding best practices. Familiarity with embedded operating systems (e.g., RTOS, Linux) and real-time system design. Experience with hardware interfaces such as UART, SPI, I2C, and GPIO. Experience with network and security protocols in embedded systems (e.g., HTTP, MQTT, TLS). Understanding of software development life cycle, including version control, unit testing, and continuous integration. Strong problem-solving skills and attention to detail. Ability to work independently and within a team in a fast-paced environment. Preferred Qualifications: Experience with consumer electronics products software development, such as Smart IP cameras, Smart Doorbells, etc. Hands-on experience with SoC bring-up and integration. Knowledge of wireless communication protocols, such as Wi-Fi and BLE. Experience in video and audio encoding (AVC, HEVC, OPUS, etc) and streaming (WebRTC, RTP, RTSP, etc.) technologies. Proven experience in designing and developing core software modules. Strong communication, interpersonal, and project leadership skills. Ability to quickly adapt to new technologies and frameworks. Benefits Salary range: $100,000 - $140,000 Free snacks and drinks, and provided lunch on Fridays Fully paid medical, dental, and vision insurance (partial coverage for dependents) Contributions to 401k funds Bi-annual reviews, and annual pay increases Health and wellness benefits, including free gym membership Quarterly team-building events At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.
Irvine, CA, USA
$100,000-140,000/year
Craigslist
Experienced Computer Repair Technician
Core Systems, a leader in rugged computer and server solutions for mission-critical defense and industrial applications, is seeking a Computer Repair Technician to join our RMA and repair operations team. This position focuses on diagnosing, troubleshooting, and repairing customer-returned products and Core Systems–built servers. Resume Required. Key Responsibilities Perform diagnostics, troubleshooting, and repair on returned computer systems, servers, and components. Process RMA units through inspection, testing, and documentation. Repair hardware at the system, component, and board level when required. Assist in root cause analysis and corrective action reports for customer returns. Work closely with engineering and production teams to support continuous improvement. Maintain accurate service records and ensure timely turnaround of customer units. Qualifications Proven hands-on experience repairing computer systems, servers, or related IT hardware. Strong knowledge of hardware components (motherboards, CPUs, memory, storage, power supplies, etc.). Experience with diagnostic tools and test equipment. Ability to read schematics and follow technical documentation. Detail-oriented, organized, and able to work under time-sensitive conditions. Previous experience in an RMA/repair environment is a MUST. Familiarity with ruggedized or military/industrial computer systems a plus. What We Offer Competitive pay and benefits package. A chance to work with cutting-edge technology in the defense and industrial markets. Collaborative, supportive team environment. Opportunities for growth and advancement within the company.
13434 Twin Peaks Rd, Poway, CA 92064, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.