Browse
···
Log in / Register

Java Developer with Web Crawler Experience

Negotiable Salary

Axiom Software Solutions Limited

Austin, TX, USA

Favourites
Share

Description

Role: Java Developer with Web Crawler Experience Location: Austin TX(Hybrid) Responsibilities: 1. Web Crawler Development: Design and implement efficient and scalable web crawlers in Java to collect data from various online sources. 2. Data Extraction: Develop and maintain systems for structured data extraction, handling various data formats (HTML, JSON, XML, etc.). 3. Data Storage and Processing: Design data storage and processing pipelines, ensuring extracted data is clean, structured, and easily accessible. 4. Performance Optimization: Optimize web crawling processes for speed, efficiency, and accuracy, while ensuring minimal impact on source websites. 5. Error Handling and Logging: Implement error-handling mechanisms and logging systems to detect and resolve issues during crawling operations. 6. Data Integrity and Compliance: Ensure data collection practices are ethical, legal, and compliant with relevant regulations (e.g., robots.txt, copyright laws). Requirements: Proficiency in Java and experience with Java-based web scraping libraries (e.g., Jsoup, Apache HttpClient). Knowledge of web crawling frameworks and tools, such as Scrapy, Selenium, or Puppeteer. Strong understanding of HTML, CSS, JavaScript, and web data structures. Familiarity with data parsing and handling techniques for JSON, XML, and other common formats. Experience with database technologies (SQL, NoSQL) to store and manage scraped data. Knowledge of HTTP protocols, headers, proxies, and load handling.

Source:  workable View original post

Location
Austin, TX, USA
Show map

workable

You may also like

Workable
Mobile App Development Engineer, Android/iOS
Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint. We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.    Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.    Overview: Are you skilled at crafting exceptional mobile applications? Do you have a passion for developing high-performance, secure, and scalable Android applications? If so, this Android Mobile App Development Engineer role might be perfect for you! In this role, you will be a crucial member of our engineering team, responsible for the design, development, and maintenance of our Android mobile applications. You'll work closely with our Mobile Architects, UX/UI designers, QA teams, and relevant product stakeholders. Leveraging your expertise in Android development and mobile technologies, you will build secure, reliable, and performant mobile apps that meet our business needs and enhance user experience.   Key Responsibilities: Development of high-caliber mobile applications for Android platform. Design, develop, release, and maintain complex mobile applications, contribute from conception to successful launch. Collaborate seamlessly with cross-functional teams, including designers, product managers, and QA engineers, to deliver unparalleled user experiences. Conduct meticulous code reviews and ensure strict adherence to coding standards and industry best practices. Stay at the forefront of the mobile development landscape by actively researching, learning, and adopting innovative technologies, platforms, and architectures. Analyze and optimize application performance, to make certain of responsiveness and a seamless user experience. Contribute to the overall architecture and strategic vision of our mobile app development initiatives. Requirements Bachelor's degree in Computer Science, Software Engineering, or a related field. Proven track record as a Mobile App Developer, showcasing a successfully released application. Minimum of 2 years of hands-on experience in mobile app development. Proficiency in programming languages such as Kotlin and Java. Knowledge of mobile app architectures, UI/UX principles, and industry best practices. Constantly prioritizing user experience and clear understanding of user requirements. Experience with version control systems (e.g., Git), continuous integration, and deployment pipelines. Exceptional problem-solving skills and a demonstrated ability to troubleshoot complex issues. Experience writing unit tests and testable code. Outstanding communication and collaboration skills. Able to actively listen and collaborate with remote global development teams. Preferred Qualifications: Familiarity with cross-platform development frameworks such as React Native or Flutter. Backend development experience and integration proficiency. Knowledge of Jetpack Compose. Experience with SDN Software Controller Platform. Experience with AI Ops. Benefits Salary range: $120,000 - $180,000 Free snacks and drinks, and provided lunch on Fridays Fully paid medical, dental, and vision insurance (partial coverage for dependents) Contributions to 401k funds Bi-annual reviews, and annual pay increases Health and wellness benefits, including free gym membership Quarterly team-building events At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.
Irvine, CA, USA
$120,000-180,000/year
Workable
.Net Developer
*MUST be Local Metro Area Candidates* *US Citizenship or work-authorization with alien registration number required* *Onsite from Day 1* *1st Interview, Webcam & 2nd interview, In- Person* *First few weeks will be in the office Monday -Thursday to work with the current development staff to learn GSFC systems and business. Then after that, in the office 2/3 days a week depending on the Agency’s requirement at that time. ** Candidate MUST meet/exceed ALL required skills** Our Web Developer is responsible for development/maintenance of both current and future web applications written using the ASP.NET framework and ASP.NET Core with C# programming language. The ideal candidate is an enthusiastic, creative, highly motivated, and goal-oriented team player with at least 5 years of ASP.NET development experience with strong knowledge of OIDC & SAML based authentication.   Essential Duties and Responsibilities: •             Write clean, scalable code written using ASP.NET Core programming language, C#. •             Develop/maintain both current and future web applications. •             Work closely with the Client User Representatives to troubleshoot and design solutions that meet requirements. •             Accurately and effectively communicate with the Project Manager and/or Team Lead the level of effort to implement proposed solutions, the           status of on-going work, and any potential issues. •             Work well in both a team environment as well as a sole contributor with little or no supervision. •             Possess excellent time management skills in handling multiple priorities with individual deadlines. •             Adapt to a rapidly changing environment and work creatively with minimal supervision. •             Ability to work from written specifications and pre-established guidelines. •             Possess excellent written and oral communication skills. Education Qualifications: •             A bachelor’s degree in Computer Science, Information Systems, or a related scientific or technical degree; or equivalent experience. Masters Degree in Computer Science, Information Systems, or a related scientific or technical degree a plus     Technical Skills/Experience: Experience working with Identity server - OIDC & SAML based authentication. Experience working with .NET Core C#, n-tier architectures and design patterns. Minimum 5 years of experience in design, development and support of ASP.NET development focus on .NET MVC Core. Minimum 5 years of experience in complete life-cycle of design, development, deployment and support of web applications. Strong knowledge of Relational Databases and working with Oracle 11g, 12c databases, MS-SQL Solid HTML, JavaScript, jQuery, CSS, Bootstrap, .NET Framework 4+, .NET Core 8+, Razor Pages, MVC 5 Experience creating and consuming REST API Experience interfacing with customers and systems analysts to understand system requirements.   Additional Desired Skills/Requirements US Citizenship or work-authorization with alien registration number required. IIS, Docker Git version control Umbraco (ASP.NET Core CMS) Visual Studio 2022 Knowledge of ColdFusion, AngularJS ( version 1 ) is a plus
405 Stubbs Ave, Monroe, LA 71201, USA
Negotiable Salary
Craigslist
Junior .NET Developer (Hybrid - remote/on-site at client office) (Midlothian, VA)
Full-time, salaried with benefits position for a Richmond, VA-based software development company. If you love software development, are looking for a new opportunity, want to work with some of the most talented developers in Richmond, and are passionately concerned about the quality of your work, our client is looking for you. Minimum Required Skill Sets • Three years of hands-on, on-the-job experience with .NET framework/Core either C# or VB.NET (C# preferred) • Experience with ASP. Net • Three years of on-the-job client-side experience with HTML, CSS, and JavaScript • Experience with common web application technology, including AJAX, JSON, RESTful API • Three years of hands-on, on-the-job experience with SQL Server development, including stored procedures, functions, and triggers Applicants must have at least two years of college, two years of work experience in the field, excellent oral and written communication skills, and work references in the United States. Applicants must reside in the Richmond, Virginia metro area. Applicants must be a citizen, or be authorized to work in the U.S. We do not offer sponsorship. This is a hybrid work environment. You will work at our client's site for 1 or 2 days each week, and work remotely for the other days. We cannot accommodate 100% remote work for this project, but we may be able to for future projects.
1700 Salisbury Dr, Midlothian, VA 23113, USA
$70,000-90,000/year
Cookie
Cookie Settings
Our Apps
Download
Download on the
APP Store
Download
Get it on
Google Play
© 2025 Servanan International Pte. Ltd.