Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Staff Embedded Software Engineer
Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint.  We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.   Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.   Overview:  As a staff embedded software engineer at TP-Link. You will be responsible for enhancing the residential device platform, which will be deployed to more than 100 million devices, creating an extensive network/IoT ecosystem for end users and ISP operators. Leveraging your expertise in embedded systems, you’ll play a key role in building an exceptional ecosystem.  In this role, you’ll design, implement, and optimize embedded software features, while developing white box testing code on platforms like Linux, PRPL, RDK, and OpenWrt. You’ll collaborate closely with cross-functional teams, including hardware engineers, product managers, and cloud services teams, to ensure seamless integration and optimal performance of the residential ecosystem. Additionally, you’ll develop and execute testing strategies to validate the robustness of your code, ensuring high quality and reliability in production environments.  Key Responsibilities:  Lead the design and architecture of complex internet gateway software.  Design, develop, execute and maintain automated software test suites for the purpose of verifying quality.  Write high-quality, efficient, and maintainable code in C or C++ for embedded systems, following best practices in software development.  Deliver high-quality code, comprehensive test cases, and clear design documentation.  Implement and enhance coding standards within the team, ensuring adherence to best practices in code quality, modularity, and reusability.  Implement continuous improvements and best practices, focusing on resource consumption optimization and network forwarding performance.  Participate actively in code reviews, providing constructive feedback to peers and mentoring junior engineers on software development best practices.  Work closely with product teams and engineers to deliver features end-to-end.  Analyze competitors and build strategies to address market challenges.  Handle customer feedback and resolve issues effectively.  Stay up to date with the latest industry standards and technologies.  Requirements Bachelor's degree in computer science, Computer Engineering, Electrical Engineering, or equivalent experience.  10+ years of experience with embedded software.  Strong understanding of computer architecture, network protocols, and related algorithms.  Proven experience in platform design and solving kernel-level crash problems.  Proven track record in identifying system bottlenecks and optimizing performance (CPU, memory, and network efficiency).  Experience in developing and executing white box tests for embedded systems.  Proficiency in C or C++ programming.  Deep knowledge of embedded systems.  Passion for learning and exploring new technologies and methodologies.    Preferred Qualifications:  Experience with the development prpl, rdk platform, with a strong understanding of their architectures and ecosystems.  Proficiency in debugging tools and methodologies for embedded systems, especially in performance optimization and crash diagnostics.  Experience working with large-scale deployments of embedded systems, particularly in networking or telecommunications environments.  Knowledge of wireless communication standards (Wi-Fi, Zigbee, etc.) and IoT protocols (MQTT).  Strong communication and interpersonal skills, with the ability to work effectively in cross-functional teams and present complex technical concepts to non-technical stakeholders.  Benefits Salary range: $140,000 - $200,000 Free snacks and drinks, and provided lunch on Fridays Fully paid medical, dental, and vision insurance (partial coverage for dependents) Contributions to 401k funds Bi-annual reviews, and annual pay increases Health and wellness benefits, including free gym membership Quarterly team-building events At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.
Irvine, CA, USA
$140,000-200,000/year
Craigslist
Cyber Security- Entry Level with Training!
Launch Your IT Career with Northstar Technologies At Northstar Technologies, we don’t just hire talent—we develop it. We’re looking for motivated problem-solvers who want to learn, grow, and build lasting careers in IT. If you bring curiosity, initiative, and the drive to take on challenges, we’ll provide the tools, training, and mentorship to help you succeed! Why Choose Northstar? We believe the best way to grow our company is to grow our people. That’s why every person starts with our hands-on, 3-month remote training program, designed to fast-track your skills with the guidance of team and access to enterprise-level equipment. What We Offer • Accelerated Learning:– In as little as 3 months (or faster, based on your pace). • Mentorship:Learn directly from experienced engineers committed to your growth. • Cutting Edge Tech: Train on modern, enterprise-grade infrastructure.. • Career Growth: Start at $22/hr with a clear path to raises and advancement. • Exciting Travel Opportunities : Gain valuable nationwide project experience, expand your professional network, and build skills in diverse environments. Work, travel, and explore! With 100% travel required, you’ll experience new cities and opportunities while your housing and relocation are fully covered. Comprehensive Benefits Medical, Dental, Vision, Life Insurance, and Paid PTO/Holidays. Who We’re Looking For Ideal candidates bring: • Problem-solving skills: You tackle challenges directly and seek new solutions. • A Willingness to Learn: You’re adaptable and eager to gain new skills. • A Team-Oriented Mindset: You value collaboration and open communication. • Attention to Detail: You’re organized and thorough. • Practical Thinking: You approach problems with an open mind and resourcefulness. Requirements: • Ability to pass a comprehensive background check (including criminal history) and drug screen. • 100% travel and relocation required (company provides housing and relocation support). • Flexibility to live and work in project cities for extended periods. • Authorization to work in the U.S. Ready to Move Forward? Send your resume to info@northstar-tek.com and start your journey with Northstar Technologies. We help businesses transform through technology, providing secure, agile, and cloud-ready IT infrastructure solutions. Our services range from strategy and consulting to design, implementation, and support.
Denver Park, 1110 17th St, Denver, CO 80202, USA
$22/hour
Craigslist
Quantitative Trading Interns (Downtown)
Job description Quantitative Trading Interns: The ideal Quant candidate will be highly proficient at researching data, pattern recognition and machine learning, statistics, econometrics or math. We will also accept recent PhD, Msc, BA/BS from top university without any experience... You will be a researcher or mathematician motivated by what’s new to ensure you're always ahead of the curve. You will understand the need and importance of strong research and strong modelling. On a day to day you will: Working on your own strategy research Back Testing models Working with the development team to execute models. Execution Latency strategy Research Machine learning research Statistics/Econometrics research Market microstructure research Below qualifications are preferred, but not necessarily a must: PhD in Maths Stats or Comp Sci from a top school MIT, Cornell, Stanford, Oxbridge, Imperial, UCL or global top 50 engineering school Good understanding of Stats and time series Understanding of relational and non-relational databases with or without using an ORM Matlab or R ideally C++ or Python Interest in quantitative problems We are also looking for Quant Development Interns: Will have a computer science degree from a top tier university with a genuine passion for programming and tackling problems, the ability to help build bespoke trading systems and tools for, with some knowledge of C++ highly desired but not essential. Requirements: Python Knowledge of time series analysis / stochastic calculus / machine learning / data mining / code optimisation would be a plus C++ The internships entails quite a range of potential responsibilities depending on your abilities and the needs of the business. You may be required to: Implement trading strategies; Build tools and engines that improve our ability to analyse data; Work on complex computational and data-related problems and implement efficient an innovative solutions; Proactively develop tools to analyse data, models, and trading, and develop platform enhancements to improve the quality of our execution; Develop visualisations, and other analytics for live and experimental trading; Improve system component performance by orders of magnitudes by improving the underlying algorithms/ method of processing / identifying systems bottlenecks; Improve the accuracy of our trading simulator, analyse differences to actual trading, and then work to improve the correlation; Design extremely high-performance, highly-reliable and finely-tuned numeric computational programs and implement such models/algorithms in python and C++ language with production quality code; Monitor our trading system and fix production problems; To do this effectively, you will need to be curious, intellectually honest, practical, purposeful, committed to high quality computer code and to apply clear judgement and critical thinking, as well as collaborate closely with others in the firm. You will be joining a small team where your impact will be immediate and tangible and will be working with experienced finance professionals who will teach you the business. We are open to hearing your ideas and encourage you to make suggestions on any area that can be improved. We aim to reward people on their contribution to firm performance including helping others and the internship will be converted into full time depending on the performance... Employment Type Full-time
World Trade Center, New York, NY 10007, USA
Negotiable Salary
Workable
Software Engineer with Clearance
What is Aviture? Aviture is a full-service technology consulting firm with expertise in software solutions for both commercial and government organizations. We believe software doesn’t mean anything unless it solves a problem, so we create technology to enable users, open possibilities, and create meaningful impact. “I wanted to create a company that I would have wanted to work at when I was an engineer.” — Mark Griffis, President We are headquartered in Omaha, Nebraska, with remote employees across the nation: Las Vegas, Washington D.C., Austin, Dallas, Portland, Green Bay, Kansas City, Madison, Minneapolis, and Orlando, just to name a few. What is Aviture’s Art of the Possible? Along with our mission-driven team’s deep expertise in a wide range of development languages, we employ a disciplined agile approach to define goals upfront, keep organizational value at the forefront, and set the pace for rapid, iterative innovation that transforms organizations. We call this the Art of the Possible. The solutions we’ve created have: Saved lives in the California wildfires and southern U.S. flooding Provided security for the 2020 Presidential Inauguration, Super Bowl, and post-attack Boston Marathon Enabled augmented-reality training environments for surgeons Increased transparency and promoted patient wellness in hospitals and senior care facilities Combined computer vision and robotics to automate dangerous manual labor tasks And much more! Why You’ll Want to Live Aviturian Aviturians create technology that makes a meaningful difference in someone’s life. We’re a team made up of designers, engineers, developers, and inventors who believe technology’s purpose is to empower users to change the world. Here are the values that guide us: Embody integrity Seek ownership Stay hungry Remain grounded Create impact Challenge with respect We’ve built our culture around creativity, continuous learning, and our shared values. If that sounds like something you’d like to be a part of, then join us today! Software Engineer Aviture is hiring a Software Engineer. Aviturians understand how technology can change the world and have the technical skills to make those visions a reality. Aviturians are always eager to learn, share, collaborate, grow, and innovate. (We also share a good meme or thirty.) We’re looking for a rockstar Software Engineer who will… Work with a cross-functional team to design, develop, test and deploy innovative solutions to a wide range of complex business problems. Actively participate in all aspects of our agile development process. Utilize effective debugging techniques to identify and resolve software defects. Continuously keep themselves up to date on changes in technology, with an emphasis on the tech stacks being used by your team. Sound like you? Apply today: Requirements BS degree in Software Engineering related degree, similar technical field of study or equivalent practical experience. Excellent verbal and written communication skills. Able to respectfully challenge the status quo. Experience developing and maintaining large-scale applications using one or more general purpose programming languages, such as:Python, Java, C#/.NET, Go, JavaScript, TypeScript Experience with one or more modern frontend technologies is a plus: ReactJS, AngularJS, VueJS, etc. Able to work both autonomously, as well as collaboratively among a team of your peers. Excellent grasp of computer science concepts, proven ability to solve complex technical problems. Experience using common design patterns in the software industry. High personal standards for code quality, maintainability, and performance. This position will require the employee to have a Secret level Government clearance or the ability to obtain one. This position will require the employee to work in person at an off-site location. Benefits PPO or a High Deductible Health Plan, HSA eligible plan, Dental, Vision, and Supplemental Life. Generous paid time off that starts accruing on day one. Hybrid work environment with quarterly Castaway Week events in the Omaha HQ Office, all expenses paid, from across the country to participate in team-building, collaboration, and fun events. Company vacations!!! Previous destinations have included Napa Valley, Cancun, Cabo San Lucas and Aspen. Matching 401k with 100% vesting in six months. Pick your preferred workstation! Mac? PC? We’ll support you with the tech you need to do your best work. Get paid to go to national and international conferences and training, so that you can stay up to date with the latest innovations. Flexible work schedules: Work the times that fits your schedule, with all meetings required to be scheduled between 9 am and 3 pm CST. Free lunch every Friday and recurring team events for you and your family to enjoy. Incentive and bonus pay. Opportunities for connection and growth through peer coaching, recurring Lightning Talks to share things we’re passionate about, and a bi-weekly company-wide All Hands.
Omaha, NE, USA
Negotiable Salary
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.