Selenium beautifulsoup jobs
Join our team as a Python Selenium Web Scraper responsible for developing scraping scripts using Python and Selenium. You'll gather data from diverse websites, utilizing your expertise in web technologies, HTML, CSS, and JavaScript. Key responsibilities include analyzing website structures, extracting and cleaning data, and collaborating with team members to integrate data into existing systems. Ideal candidates possess proficiency in Python, experience with Selenium, and a strong understanding of web technologies. This role offers competitive compensation, flexible work hours, health benefits, and opportunities for career growth in a dynamic, collaborative environment
...process to ensure accuracy and efficiency. Clean and structure the collected data into readable and usable formats. Integrate the extracted data into a database or spreadsheet as needed. Collaborate with our team to understand specific requirements and ensure the quality of the obtained data. Requirements: Demonstrable experience in web scraping using tools like Python (Beautiful Soup, Scrapy), Selenium, etc. Solid knowledge of HTML, CSS, and JavaScript to understand the structure of web pages. Ability to work independently and meet established deadlines. Excellent communication skills and ability to work in a team. Preferably, previous experience in data extraction projects related to the specific sector of the project (if applicable). If you have the skills and passion to deli...
Fixed bugs with iCloud website. Automation press button (2bugs only)
The EdgeRecorder project aims to provide a tool for recording user interactions on web pages through a plugin for Microsoft Edge. This plugin captures user actions and generates useful information such as XPath, ID, Name, and other attributes of the elements. The main goal is to facilitate test automation and improve efficiency in web development.
...build a python flask script with a single INPUT form to submit then scrape record data including ( 2 URL ) image thumbnail and record information from a website that requires username and password authentication. Skills and experience needed: - Experience in web scraping - Proficiency in programming languages such as Python - Knowledge of authentication protocols - Familiarity with tools and selenium libraries for web scraping - Attention to detail to ensure accurate data extraction - Ability to handle and manage large amounts of data efficiently Project deliverables: - A script or program that can scrape the desired text information from the website - - i will need 2 URL's and 1 thumbnail scraped. GUI will ask to enter number of the record to be scraped. Scri...
I'm looking for an experienced VBA programmer to extend and modify the existing 'getpdf' project. The key focus is on integrating it with Microsoft Excel. Key Responsibilites: - Integration with Microsoft Excel: This involves extracting data from E...looking for an experienced VBA programmer to extend and modify the existing 'getpdf' project. The key focus is on integrating it with Microsoft Excel. Key Responsibilites: - Integration with Microsoft Excel: This involves extracting data from Excel files and downloading data from VBA which is PDF-based data, renaming it, and using Selenium. Ideal Skills: - Strong VBA programming skills. - Proficiency in integrating VBA with Microsoft Excel. - Experience with Selenium for web data extraction. - Prior wo...
In this project, I am seeking an expert in data mining who is proficient in using Python libraries such as BeautifulSoup. Your task is to scrape names and contact details from numerous business directories. Ideally, you will have: - Experience using Python for web scraping, especially with BeautifulSoup. - An understanding of different business directory structures and the ability to adapt your scraping methods as necessary. - Exceptional attention to detail to ensure all data scraped is accurate and relevant. - Respect for the privacy and ethical standards associated with data extraction. Your role will involve: - Identifying key data on business directories: primarily names and contact details. - Creating efficient, reusable, and reliable Python code to scrape this inf...
I need a talented Python developer with Selenium expertise to create automated scripts for a series of complex web tasks. Key responsibilities: - Writing Python scripts to automate complex web interactions that include conditional logic - Ensuring the scripts are reliable, efficient and scalable Ideal skills and experience: - Proficiency in Python - Solid understanding of Selenium - Experience in developing automated scripts for complex web tasks - Knowledge of best practices for writing efficient and maintainable automation scripts - Good understanding of web technologies and how they interact, including conditional logic The successful candidate will need to demonstrate their ability to deliver high-quality, robust and scalable solutions within tight deadlines.
Currently, I'm working with Python Selenium and attempting to create a script that can consistently log in to websites like vfsglobal, such as "", every minute without triggering their IP blocking mechanism (which kicks in after about 5 attempts from the same IP). I've purchased proxies from and integrated them into my script, but unfortunately, they only seem to work for HTTP, not HTTPS. I'm curious about a solution to this problem. Is it feasible to set up a server (like Google Cloud or AWS) that utilizes a unique IP addresse for each request? Any insights you could provide would be greatly appreciated.
...Hashtag trends - SM users' specific usage of a small number of terms relating to claims of "stochastic terrorism" and "stochastic violence" Priority would be given to freelancers demonstrating: - Previous experience in web scraping, particularly from social media platforms. - Strong Python skills since Python-based tools are commonly used for web scraping. Knowledge of libraries such as BeautifulSoup, Selenium or Scrapy would be a plus. - Ability to organize and clean the data into an easy-to-understand format. - Understanding of Twitter’s policies on data scraping to ensure the legality of the data collection process. The prompt completion of this project isn't my main concern as we have a project planned out, but need your quotation...
I'm currently looking for an experienced Selenium developer who can effectively extract data from a yet-to-be-determined website. The nature of the data to be extracted is also uncertain at this point but might include text content, images, or links. Ideal Skills and Experience: - Expertise in Python and Selenium - Proficient at web scraping - Good understanding of data structures and databases - Effective communication skills The timeline for the completion of this project is open-ended and will be further discussed once we have agreed on the terms of your engagement.
...criteria: You should use the selenium/standalone-chrome image, so the Chrome should be running in the Docker environment The sample control page with the sliding verification mechanism will be sent to you during the recruitment process. Requirements and Skills: Proficiency in utilizing the Selenium/standalone-chrome image within a Docker environment to address challenges. Ensure compliance with website policies and security protocols throughout the development process. - Python - Test Automation - Website Testing - Selenium Webdriver - Selenium Note: We are solely seeking enhancements that align with the specified criteria using Selenium/standalone-chrome images. Please only apply if you have successfully completed the verification process using ...
...goal is to improve the resolution process for these challenges while following website protocols and upholding security standards. Requirements: You should use the selenium/standalone-chrome image, so the Chrome should be running in the Docker environment Ensure compliance with website policies and security protocols throughout the development process. Python Test Automation Website Testing Selenium Webdriver Selenium Note: We are solely seeking enhancements that align with the specified criteria using Selenium/standalone chrome images. Please only apply if you have successfully completed the verification process using Selenium before. The example page and necessary details will be provided to you. Full payment is only done after a successful solutio...
I'm seeking a skilled JavaScript developer who has expertise in writing scripts for both front-end and back-end development, and has experience in Selenium scriptwriting. Key responsibilities: - Writing JavaScript code for both front-end and back-end development - Creating scripts for Selenium, which includes setting up automation tests, writing test scripts, and possibly troubleshooting existing tests The ideal candidate should have: - Profound knowledge and experience in JavaScript coding - Proven experience in writing scripts for both front-end and back-end - Familiarity with Selenium, its setup, test scripting, and troubleshooting - Strong problem-solving skills and the ability to work independently This is a great opportunity for someone who enjoys working...
I'm seeking a skilled JavaScript developer who has expertise in writing scripts for both front-end and back-end development, and has experience in Selenium scriptwriting. Key responsibilities: - Writing JavaScript code for both front-end and back-end development - Creating scripts for Selenium, which includes setting up automation tests, writing test scripts, and possibly troubleshooting existing tests The ideal candidate should have: - Profound knowledge and experience in JavaScript coding - Proven experience in writing scripts for both front-end and back-end - Familiarity with Selenium, its setup, test scripting, and troubleshooting - Strong problem-solving skills and the ability to work independently This is a great opportunity for someone who enjoys working...
I'm looking for someone to help me with a Selenium Webdriver python script. I don't need help with scraping, but in managing the Chrome browser in the background.
I'm seeking a full-time Test Engineer role in the technology industry. Key Requirements: - Extensive knowledge of software testing methodologies - Experience in using testing tools like Selenium, JUnit, TestNG, etc. - Proven track record of writing clear and concise bug reports - Strong analytical and problem-solving skills - Ability to work in a fast-paced environment and meet deadlines Ideal Candidate: - At least 3 years of experience in software testing - Relevant qualifications in computer science or related field - Prior experience in a similar role - Excellent communication and teamwork skills In this role, you'll be responsible for ensuring the quality of our technology products through rigorous testing. You'll work closely with our development team to ide...
I am looking for an experienced Selenium developer that can help create a code for automatic PDF downloads from a website. This PDF contains a captcha that needs to be successfully navigated. Requirements: - Expertise in Selenium development for automation - Experience with PDFs, specifically being able to automate their download - Knowledge in Captcha Bypass techniques - Understanding of data extraction procedures The primary focus is the automation of PDF downloads from the specified source. Please note, these PDFs have captcha security hence familiarity with handling such features is a necessity. Essentially, your task will be to retrieve these PDF files from the website for data extraction and offline access. Knowledge of text-based data extraction from PDFs will ...
I need an expert in data scraping to extract detailed information from Airbnb. The information required includes: Host Data: - Extract the names of the hosts, their contact information, and their ratings. Listing Data: - Scrape the listing titles, descr...contact information, and their ratings. Listing Data: - Scrape the listing titles, descriptions, and the amenities offered. Also, delve into the pricing information to better understand the market trends. Ideal candidates should have previous experience in data scraping, preferably within the hospitality industry, and should be familiar with platforms like Airbnb. Proven knowledge of Python, BeautifulSoup, or similar tools is a must. I am looking forward to working with an individual who can provide accurate results in a time...
I need a proficient tester experienced in Java, Selenium and Appium for automation testing of my application's main functionalities: User Authentication, Data Processing and User Interface Interaction. Knowledge in these areas is crucial: - User Authentication: Ensuring correct and secure user login and registration. - Data Processing: Confirming accurate data input, storage, and retrieval mechanisms. - User Interface Interaction: Verifying user interactions are responsive and correctly implemented. Familiarity with Selenium and Appium for automation testing is essential. You will be tasked with creating, executing, and managing tests to ensure the application is performing as expected. Looking for someone who is detail-oriented and can provide regular progress reports...
I need of code in Python (Selenium) to get information of product page of a marketplace. The method/function need receive the link of page, and the code must create a directory and save inside this directory, the video and images of product. Must create file (ex xml, csv) and save the title of product, description of product, price and discounted price when offered, basic information.
I am in need of an expert web scraper who can fetch information from Make.com. It's not necessary for you to extract a particular type of data as I haven't decided on the specifics yet so versatility is key. Ideally, I'd like your application to include: - Detailed project proposals While it would be advantageous if you're proficient in certain web scraping tools like Python with BeautifulSoup, JavaScript with Puppeteer, or Php with Goutte, I do not have a specific requirement, indicating flexibility in the tools you employ. Your ability to choose the right tool for this project will be part of your proposal. Feel free to apply if you can handle this task.
In this project, I need a skilled individual to automate testing for my web applications. Your primary focus will be functionality testing. As for the testing framework, I would like the work to be done using Selenium. Here are the specifics of the project: - You'll be performing functionality testing, to make sure everything operates as expected. - The testing framework of choice is Selenium, I expect you to be proficient using it. To complete this project, you'll need an excellent understanding of Selenium and a strong experience in automation testing for web applications. Your expertise in functionality testing will be a major plus. Please provide proven examples of previous work in this area. Your ability to deliver on time and maintain clear communicat...
I'm facing an issue with my Python script that uses Selenium WebDriver. • Error: While running the script, I'm getting a 'No Such Element' error. • Problem Element: The error reports a missing dropdown menu. • Expected Functionality: The script is intended to make the dropdown menu display all options. To resolve this issue, I need a Python expert, specifically one with significant experience handling Selenium WebDriver. The ideal candidate should have excellent debugging skills to trace and eliminate the root issue. Knowledge of web application interactions, particularly with dropdown menu behaviors, is crucial.
In this project, I am looking for an experienced web automation engineer to fix errors in the Phyton script that uses (selenium Webdriver ) to browse and click
My existing Java Selenium automation script is running, however, it's producing incorrect results, which is adversely affecting my ability to take decisions based on the output of the script. I'm in need of professional assistance to fix this issue. Ideal Skills: - Proficiency in Java - Expertise in Selenium - Strong debugging skills - experience with testng and maven Experince with Intellij IDE - Solid understanding of automation testing Potential bidders should be able to provide experience of their past work relevant to Java and Selenium automation scripts. Showcasing skills that demonstrate your ability to effectively find, investigate, and resolve bugs in similar scripts would be highly advantageous. Let the debugging begin!
I am seeking a specialist proficient in QA automation with Selenium, core Java, Excel data validation, SQL database validation using JDBC, and Jenkins. You should be available to work within the US timezone CST (8 AM to 5 PM). Key Responsibilities: - Automation tasks including data, input, and field length validations - Form filling and regression testing - Filling the form with random data for testing Ideal Skills and Experience: - Proven experience in QA automation - Proficiency in Selenium, Core Java, and Jenkins - Strong knowledge of SQL database validation using JDBC - Excellent understanding of data validation principles in Excel - Adherence to the US timezone for work collaboration This role is perfect for those who are thrilled by the challenges and intricacies o...
I am seeking an experienced QA Automation Engineer to set up automated testing using Selenium Java, JDBC, excel data validation and Jenkins. This project will focus on testing data validation functionality on Google Chrome. Skills and Experience Required: • QA Automation • Selenium Java • JDBC • Jenkins • Knowledge of Google Chrome for testing The role involves: • Developing a robust and efficient testing framework specifically for Chrome. • Focusing primarily on data validation functionality. • Delivering results ASAP, and able to work on tight timelines. If you are a QA specialist with a solid background in Selenium Java automation, you could be the perfect fit. Your fast-track abilities to implement testing for data validat...
Need a Python expert with Selenium skills for a form automation tool. It autofills Google Forms, generates random answers for required fields, and adapts to form variations. Include your experience in your application.
I'm looking for a skilled C# .NET developer to create a BOT for my project. The BOT will primarily focus on web scraping and collecting data from websites. Once data is collected, I would like the BOT to store data in database Key Requirements: - Proficiency in C# .NET development. - Experience in web scrapin...NET development. - Experience in web scraping and data collection. - Ability to generate reports from collected data. Since the BOT's task is focused on web scraping, familiarity with tools and libraries commonly used in web scraping is a plus. The ideal candidate should be able to deliver a reliable and efficient BOT with a high level of accuracy in data collection and reporting. You can use selenium, CEF Charp. The website use aggrid to load grid. So you need ...
I am looking for a freelancer who can help me compar...analysis - Knowledge of automobile accessories Please make sure you have experience with comparing and analyzing product data from online marketplaces. Responsibilities: Utilize Selenium to scrape data from various websites to identify the top 10 products in the automobile (Accessories) industry from Shoppee and Lazada. Compile a comprehensive activity list for each of the identified products, including pricing, features, customer reviews, and any relevant trends or developments. Provide regular updates on the progress of the research and any challenges encountered. Requirements: Proficiency in web scraping using Selenium or similar tools. Solid understanding of the automobile industry and familiarity with popular pro...
I'm in need of a highly skilled and experienced Selenium to scrape for a specific website. The major task involves extracting intricate table data from the website.
We have a desktop aplication (c#, dotnet 4.5) that sending bulk message to whatsapp using (chromedriver and whatsapp web - using Selenium Driver). Main points: - Send text message, attched files, attached pic with caption text - Extract contacts. - Extract groups numbers - Autoreply, depends on list of stored choices. - Number's filter (has whatsapp or not) we are using : as a refernce . now it's not working any more. Liverary will be handled with source code. Kindly, who only have an eperience on this issue. Thank you
Looking for an expert in Selenium and Python for personal project. I require a solution that effectively automates the login process on specific movie websites. Key Responsibilities: - Develop login automation using Selenium and Python - Provide clear instructions for use - Provide detailed documentation or clear code comments - Must be reliable and able to complete tasks quickly Ideal Skills: - Advanced Python coding skills - Proficiency in Selenium python library - Experience with overcoming anti-scraping measures - Strong problem-solving skills Successful completion of this task could open the door to future projects. Need this done ASAP. The specifics will be discussed over chat. Looking forward to your bids.
I'm in need of a Selenium guru - someone who is skilled in writing scripts, regardless of the programming language -, Java, or JavaScript. The task is straightforward: copy data from one website to another.
We are looking for a skilled programmer to automate an online booking process. The task requires the automation to run on specific days and at a specific time. This project is crucial for ensuring bookings are made without manual intervention. Responsibilities: - Develop and implement a robust automation script that can handle the online booking process. - Ensure the automation is scheduled to run at predetermined times and days. - Test the automation thoroughly to guarantee reliability and efficiency. - Provide documentation on the automation process and instructions for future modifications. Here is the Website Link: Please apply with examples of similar automation projects you have successfully completed. We are looking forward to automating our booking process with your help!
I'm looking for a QA Automation Tester. Automation Testing: The candidate should be proficient in automation testing using tools like Selenium, Cucumber, HP UFT, and JMeter. They should be able to create and execute automated test scripts, generate test reports, and identify and report bugs. • Must have experience in Java coding • Preferred to have experience in Tosca • Candidate must have experience working with SAP and Salesforce environment and/or integrations. • Documentation and Reporting: The candidate should be able to maintain documentation of system configurations, test scripts, and test results. They should be able to generate reports and dashboards for management review. • Collaboration and Communication: The candidate should be able to work ...
Web scraping selenium and image background removal and also some help with shopify
I require an experienced data scrapping professional to extract tables from 4 specific webpages. The details include: - Scrapping Tables: Each page has structured tables with consistent columns that need to be scraped. The tables ...professional to extract tables from 4 specific webpages. The details include: - Scrapping Tables: Each page has structured tables with consistent columns that need to be scraped. The tables have a mix of textual and numeric data. The task requires accuracy in extracting these data elements. - Expertise: Ideal experts must have prior experience in HTML/CSS, Python, and Web Scrapping. Experience with BeautifulSoup, Scrapy, or similar tool is a plus, as it will make dealing with tables easier and more efficient. Please bid with your past experience and...
Join our team as a Python Selenium Web Scraper responsible for developing scraping scripts using Python and Selenium. You'll gather data from diverse websites, utilizing your expertise in web technologies, HTML, CSS, and JavaScript. Key responsibilities include analyzing website structures, extracting and cleaning data, and collaborating with team members to integrate data into existing systems. Ideal candidates possess proficiency in Python, experience with Selenium, and a strong understanding of web technologies. This role offers competitive compensation, flexible work hours, health benefits, and opportunities for career growth in a dynamic, collaborative environment
I urgently need an experienced data scraper who can meticulously extract the text content and links from specific webpages. Your core responsibiliti...webpages. Your core responsibilities will include: - Accurate and efficient data extraction from targeted webpages - Utilizing cutting-edge scraping tools and scripts to automate the process - Ensuring all text content and links are correctly pulled and stored Ideal Skills: - Prior experience in data scraping, particularly with webpages. - Proficiency in using scraping tools such as Scrapy, BeautifulSoup, or other similar utilities. - Keen attention to detail and accuracy. - Ability to deliver work promptly as this project has high time sensitivity. Please bid if you can deliver this project ASAP without compromising the qualit...
...- If the supplier is verified - What the product is - A link to the product page - How many you need to order if you want custom packaging Easy to Review and Use: You can download the info as a CSV file, making it super easy to look over and make decisions. Building It: The Tech Behind It: We're thinking Python because it’s great for this kind of job, using tools like Selenium for browsing Alibaba, BeautifulSoup for looking through the webpage content, and pandas for organizing and saving the info. How You’ll Use It: We’re keeping it simple. You can type your search right into the command line, or if you’d prefer something a bit more visual, we’ll make a basic graphical interface. Keeping Things Organized: All the info we find wi...
I need an experienced Python developer who can proficiently extract tables from a PDF document. Key Requirements: - The tables in the PDF are mostly well-structured but there might be few exceptions where you will n...to handle irregularities. - You must have extensive experience in handling and extracting data particularly for inconsistent or complex table structures. - The final scraped data should be delivered in an Excel file. Ideal Candidate: - Extensive experience with Python and data scraping, with particular experience in handling table data. - Proficient in using Python data scraping tools like BeautifulSoup, Scrapy etc. - Good understanding of handling and transforming data in Microsoft Excel. - Strong problem-solving skills to handle potential challenges with table s...
...websites. 2. Extract relevant data points such as election dates, candidates, voter turnout, election results, and any other pertinent information. 3. Ensure accuracy and completeness of scraped data. 4. Organize and format the scraped data for easy analysis and integration into our database. *Requirements:* 1. Proficiency in web scraping techniques using tools like Python's BeautifulSoup, Scrapy, or similar frameworks. 2. Experience in data extraction and manipulation. 3. Ability to work with large datasets and handle multiple sources simultaneously. 4. Attention to detail and accuracy in data collection. 5. Strong communication skills and ability to provide regular updates on progress. 6. Time commitment: Expected completion within 3 days from...
I am seeking an experienced freelancer proficient in web scraping for the creation of a script. This script should extract textual information every day from a website, this information will be used by another software to update our stocks accordingly. The ideal candidate should have: - Proficiency in python and BeautifulSoup, or similar technologies. - Prior experience in data extraction Outlined below are the specific requirements: - The script should have the capability to extract textual data from a website. - The collected data is to be formatted as a CSV file. This demands both technical prowess and an analytic mindset to ensure information is collected efficiently and formatted correctly.
I am seeking an experienced freelancer proficient in web scraping for the creation of a script. This script should extract textual information every day from a website, this information will be used by another software to update our stocks accordingly. The ideal candidate should have: - Proficiency in python and BeautifulSoup, or similar technologies. - Prior experience in data extraction Outlined below are the specific requirements: - The script should have the capability to extract textual data from a website. - The collected data is to be formatted as a CSV file. This demands both technical prowess and an analytic mindset to ensure information is collected efficiently and formatted correctly.
Hi, I am seeking a skilled individual to execute my python scraping script on a server. Ideally, you should have: - Extensive experience in running python scraping scripts on servers - Know good and cheap servers to choose from - Ability to start and complete the task ASAP - Extensive Selenium knowledge - Servers must be able to run GUI as my scripts are using Selenium My maximum budget is $15 for this process as its not really a programming job, but only server installing and script uploading. IF YOU CANNOT COMPLETE THIS FOR $15 DO NOT APPLY
...team to fix. The role will be entirely remote, giving you the flexibility of working from home. Candidate’s Experience ------------------------------------------------------ The candidate will need to have at least 1 year experience designing, developing and executing automated / manual testing on web applications. Key Skills Required: - Proficient with automated testing tools such as Selenium WebDriver or Cucumber - Experience using Jira for bugs tracking - Experience designing, developing, executing and maintaining automated and manual test scripts - Experience performing manual testing of web applications on desktop and mobile - Functional analysis of new implementations - Experience performing regression test automation Desirable Skills: - Experience wi...
...team to fix. The role will be entirely remote, giving you the flexibility of working from home. Candidate’s Experience ------------------------------------------------------ The candidate will need to have at least 1 year experience designing, developing and executing automated / manual testing on web applications. Key Skills Required: - Proficient with automated testing tools such as Selenium WebDriver or Cucumber - Experience using Jira for bugs tracking - Experience designing, developing, executing and maintaining automated and manual test scripts - Experience performing manual testing of web applications on desktop and mobile - Functional analysis of new implementations - Experience performing regression test automation Desirable Skills: - Experience wi...
