Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Mobile App Development Engineer, Android
About Us: Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint. We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.  Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.  Overview: Our success hinges on the innovative efforts of the TP-Link Global R&D Center, California's tech innovation hub. The center spearheads research and development in next-gen networking, IoT smart home products, and software services, setting the stage for a transformative user experience. Join the TP-Link Global R&D team as an Android App Development Engineer, where you'll collaborate with leading R&D directors, Cloud Architects, UX/UI designers, QA teams, and key hardware personnel. Your contributions will impact TP-Link products and services worldwide, touching the lives of millions. Responsibilities: Development of high-caliber mobile applications for Android platform. Design, develop, release, and maintain complex mobile applications, contribute from conception to successful launch. Collaborate seamlessly with cross-functional teams, including designers, product managers, and QA engineers, to deliver unparalleled user experiences. Conduct meticulous code reviews and ensure strict adherence to coding standards and industry best practices. Stay at the forefront of the mobile development landscape by actively researching, learning, and adopting innovative technologies, platforms, and architectures. Analyze and optimize application performance, to make certain of responsiveness and a seamless user experience. Contribute to the overall architecture and strategic vision of our mobile app development initiatives. Requirements Required Qualifications: Bachelor's degree in Computer Science, Software Engineering, or a related field. Proven track record as a Mobile App Developer, showcasing a successfully released application. Minimum of 2 years of hands-on experience in mobile app development. Proficiency in programming languages such as Kotlin and Java. Knowledge of mobile app architectures, UI/UX principles, and industry best practices. Constantly prioritizing user experience and clear understanding of user requirements. Experience with version control systems (e.g., Git), continuous integration, and deployment pipelines. Exceptional problem-solving skills and a demonstrated ability to troubleshoot complex issues. Experience writing unit tests and testable code. Outstanding communication and collaboration skills. Able to actively listen and collaborate with remote global development teams. Additional Skills (Preferred): Familiarity with cross-platform development frameworks such as React Native or Flutter. Backend development experience and integration proficiency. Knowledge of Jetpack Compose Benefits Salary range: $100,000 - $150,000 Free snacks and drinks, and provided lunch on Fridays Fully paid medical, dental, and vision insurance (partial coverage for dependents) Contributions to 401k funds Bi-annual reviews, and annual pay increases Health and wellness benefits, including free gym membership Quarterly team-building events At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.
Irvine, CA, USA
$100,000-150,000/year
Workable
Senior Software Engineer
What is Aviture? Aviture provides custom software solutions for clients, acting as a business partner and technical advisor – sharing and contributing to our client’s vision. We provide full lifecycle software services from concept, implementation and first delivery on to continued maintenance, analysis, and continued adaption to user needs and market forces. At Aviture we treat our employees as people, not resources. We value their personal & professional growth believing that stronger and healthier individuals are good for both our employees and our clients. Using our principle of ‘cross pollination’ – we actively share problems & solutions between our project teams and provide ample opportunities for employees to advance to different teams at opportune moments to grow and mentor. The exposure to multiple industries and aspects of technology presents an ideal environment in which you can continue to master your trade skills, as well as be exposed to many developing technologies & interesting problem spaces. Additionally, we encourage the inter-communication and mingling of our employees – to include company sponsored vacations, quarterly ‘cast away’ weeks where we co-locate our employees to further collaborate, and many social functions and internal interest groups. We are headquartered in Omaha, Nebraska, with remote employees across the nation: Las Vegas, Washington D.C., Austin, Dallas, Portland, Green Bay, Kansas City, Minneapolis, and Orlando, just to name a few. What is Aviture’s Art of the Possible? Along with our mission-driven team’s deep expertise in a wide range of development languages, we employ a disciplined agile approach to define goals upfront, keep organizational value at the forefront, and set the pace for rapid, iterative innovation that transforms organizations. We call this the Art of the Possible. The solutions we’ve created have: Saved lives in the California wildfires and southern U.S. flooding Provided security for the 2020 Presidential Inauguration, Super Bowl, and post-attack Boston Marathon Enabled augmented-reality training environments for surgeons Increased transparency and promoted patient wellness in hospitals and senior care facilities Combined computer vision and robotics to automate dangerous manual labor tasks And much more! Why You’ll Want to Live Aviturian Aviturians create technology that makes a meaningful difference in someone’s life. We’re a team made up of designers, engineers, developers, and inventors who believe technology’s purpose is to empower users to change the world. Here are the values that guide us: Embody integrity Seek ownership Stay hungry Remain grounded Create impact Challenge with respect We’ve built our culture around creativity, continuous learning, and our shared values. If that sounds like something you’d like to be a part of, then join us today! Senior Software Engineer Aviture is currently hiring a Senior Software Engineer to join our team and support the continued development of the United States Air Force’s primary recruiting and public-facing application – Aim High. If hired, you will be contributing to a platform which sets aspiring individuals on a path for career growth and personal development, provides viable options for education and a lucrative future for those typically underserved, and help connect families to loved ones as they enter a career in the US Air Force. This role involves working as a part of a mature, cross functional, agile development team with generalized specializations in UX, UI, Mobile, Cloud Engineering (AWS), DevOps and QA. The ideal candidate should have deep experience working on professional level mobile applications with mature cloud-hosted backends. The specific stack being used is React Native, Expo, AWS with a serverless paradigm, MongoDB, Elasticsearch, React.js, Strapi, React Native Testing Library, and Appium – the greater exposure to these frameworks the better. We’re looking for a Senior Software Engineer who will… Deliver solutions to complex technical challenges both independently and as a part of a cross-functional team. Communicate clearly in a timely manner in both verbal and written forms. Actively participate in all aspects of our agile development process. Assist in establishing and enforcing coding standards within their team. Work with project stakeholders to decompose complex requirements into smaller sets of iterative deliverables. Recognize and recommend design patterns for developing reliable, highly available, scalable and performant software solutions. Identify opportunities to improve upon engineering processes within their team. Provide technical mentorship and direction to peers. Utilize effective debugging techniques to identify and resolve software defects. Look beyond the immediate needs of a product and help consider longer-term concerns and/or opportunities for impact from our products. Continuously keep themselves up to date on changes in technology, with an emphasis on the tech stacks being used by your team. Requirements BS degree in Software Engineering related degree, similar technical field of study or equivalent practical experience. 7+ years of professional software development experience building and shipping production grade software or services. Advanced knowledge of software testing tools, frameworks, and techniques. Proficient in at least two modern programming languages (Python, Java, C#/.NET, Go, JavaScript, TypeScript). Excellent verbal and written communication skills. Able to respectfully challenge the status quo. Experience developing and deploying cloud native software on the AWS cloud. Experience using serverless technologies like Lambda, API Gateway, and DynamoDB is preferred. Experience with UI development using ReactJS and/or React Native. Gets excited by the challenge of complex technical problems. Competent with relational databases and SQL. Excellent grasp of computer science concepts, data structures, algorithms, and design patterns. Ability to design and provide solutions to complex business problems. Strong working knowledge of Agile development processes. Passionate about mentoring and training junior software engineers. High personal standards for code quality, maintainability, and performance. Benefits PPO or a High Deductible Health Plan, HSA eligible plan, Dental, Vision, and Supplemental Life. Generous paid time off that starts accruing on day one. Hybrid work environment with quarterly Castaway Week events in the Omaha HQ Office, all expenses paid, from across the country to participate in team-building, collaboration, and fun events. Company vacations!!! Previous destinations have included Napa Valley, Cancun, Cabo San Lucas and Aspen. Matching 401k with 100% vesting in six months. Pick your preferred workstation! Mac? PC? We’ll support you with the tech you need to do your best work. Get paid to go to national and international conferences and training, so that you can stay up to date with the latest innovations. Flexible work schedules: Work the times that fits your schedule, with all meetings required to be scheduled between 9 am and 3 pm CST. Free lunch every Friday and recurring team events for you and your family to enjoy. Incentive and bonus pay. Opportunities for connection and growth through peer coaching, recurring Lightning Talks to share things we’re passionate about, and a bi-weekly company-wide All Hands.
Omaha, NE, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.