Data scraping asp net jobs
I'm in need of a talented Keycloak software developer with a solid grasp of .NET. The primary goal of this project will be to develop a custom user management and authorization system. Key Responsibilities: - Create a custom user management and authorization system using Keycloak - Implement role-based access control - Develop user registration and profile management features - Integrate the solution with our existing user database The ideal candidate for this project would have: - Proficiency in Keycloak - Extensive experience with .NET - A strong understanding of user management systems and implementing role-based access control - Previous experience integrating user databases List of views: - Login - Users - App roles - User groups Development for User Management...
...Agent to connect to local database and file system * Local Database * Use Azure Storage or Microsoft SQL Server as local database * Store indexed data and search results in local database * File System * Use Windows File System or macOS File System * Index local files and folders * Search * Search local database and file system for relevant results * Display search results in user interface * User Interface * Develop user interface for Quivr Agent * Include search bar, search results, and settings Cloud Component: Calendar Service * Calendar Integration * Integrate with Microsoft Graph API for calendar data * Retrieve calendar events and appointments * Event Processing * Process calendar events and appointments * Extract rele...
I need a Python script that can scrape ALL images uploaded on Stackexchange posts related to LaTeX, especially those tagged with tikz/pgfplot. The primary goal for collecting these images is ...create a personal database of the best illustrations asked and made by users. Key Requirements: - Ability to scrape Stackexchange posts specifically related to LaTeX - Must be able to identify and download all images in the posts - Organize the images with their corresponding posts Ideal Skills and Experience: - Proficiency in Python - Experience with web scraping and data extraction - Familiarity with Stackexchange's layout and data structure - Ability to handle and download images from web sources Please submit detailed project proposals outlining your approach to achi...
I'm in need of a developer who can create a web scraper for the marketplace. Your main task will be to ...Key Requirements: - Extracting card details (name, stars, price, last sale price) and bids (price, quantity, time) - Applying filters based on card attributes like rarity Ideally, I would like the data to be updated on a daily basis. This means you will have to set up the scraper to periodically check for new information and update the existing dataset accordingly. Skills and Experience: - Proficient in web scraping - Experience with scraping marketplaces or similar platforms - Familiarity with filtering and updating scraped data - Ability to work with large datasets and handle real-time data updates Please let me know your relevant experien...
...application in Linux instead of Windows against my guidelines. In light of this, I am seeking a highly skilled professional to help me reinstall the system and rectify all the problems at hand. The job involves the following steps: 1) Change the OS from Linux to Windows Server 2016 or Higher (This may cause the data to be erased. In this case use the copy of the site and reinstall 2) Download Windows Server 2016 II, Office 2019, , .NET Framework 4.7 or 4.8, Visual FoxPro 9 Executable. And it should be Configured to the present environment. 3) In the first menu of , there is a function “Chemplan Online”. Chemplan database and EXE are residing at the server, this should be connected to the online function discussed
Project Description: I need a developer to create a system that queries multiple external sources (18) through APIs, web scraping, and web page reengineering processes to extract information and structure it in the expected format. The system should generate a record of each query made, indicating whether results were obtained, no results were obtained, or if the source was not available. A document detailing all the sources of information from which data should be extracted will be provided. Main Features: 1. Automatic Querying of External Sources: Perform queries to multiple external sources according to the provided specifications. 2. Data Structuring: Process the obtained information and structure it in the required format. 3. Query Log Generation: Create a detai...
I am seeking an experienced developer proficient in creating complex, feature-rich applica...Sales and delivery order tracking system for customer convenience. - The inclusion of an AI upselling feature tailored to client interests. - Click & Collect option for alternative product acquisition. - Open source data and web scraping capabilities for refined data category management. Design: The aesthetic should be minimalistic and clean, placing emphasis on functionality and ease of navigation without sacrificing style. Store based on Grocery - food & drink products. It is essential you have previous experience with e-commerce, AI implementation and open-source data technologies within app and web development. I look forward to viewing examples of past ...
...on a contract basis as a Geofencing and Data Visualization Specialist. The ideal candidate will possess expertise in geofencing technology, data integration, visualization tools, and cloud platform automation. Responsibilities: 1. Geofenced Mapping: Utilize bulk Google Sheets data to create geofenced mapping solutions. Implement geofencing techniques to accurately map addresses and locations and precise boundary definitions for target areas. Includes visual enhancements for clustering data and map filtering. 2. Data Integration: Integrate web scraped data into geospatial existing datasets. Ensure seamless integration and compatibility with mapping and visualization tools. Enhancing our overall data analytics capabilities. a. Integrate th...
I am looking for an individual or a business with a strong network of high net worth individuals and/or family offices that would be willing to introduce me to and help me pitch to them an Accountancy Practice Roll-Up project I am running and requires funding. I am looking to raise £500,000 in equity in rounds 1 and 2, within 3-9 months time. The payment will be as a percentage of the funds raised successfully for the project through this person or company. It will have to be equity participation. Loans are not considered at this stage. - Strong Network: Leveraging your connections to high net worth individuals is crucial. I need to tap into your relationships to pitch my business concept. - Industry Experience: Having a background in raising funds for roll ups, s...
I'm looking for a web scraping expert to help me gather personal profiles, email, and phone numbers from LinkedIn. The data I need should be based on broad search queries. Key Requirements: - Extract specific data: personal profiles, email and phone numbers - Data source: LinkedIn - Search type: Broad search query - Search criteria: Job title or role, Geographic location Ideal Skills: - Proficient in web scraping - Experience extracting data from LinkedIn - Ability to create custom search queries - Prior experience in gathering personal contact information
As a website owner, I am in need of a freelancer to scrape the text content from the unstructured, plain text and...owner, I am in need of a freelancer to scrape the text content from the unstructured, plain text and HTML of my website's homepage. Tasks to complete for this project will include: - Identify valuable text data from the webpage - Create scripts or suitable methods to extract this text data - Clean and deliver the scraped data in a readable, usable format The ideal candidate for this position will be proficient in data scraping technologies, HTML, Python (or similar), and have the ability to work with unstructured data efficiently. Prior experience in a similar project and familiarity with data cleaning will be a huge plu...
I am seeking for a skilled web scraper who can effectively extract product information from onl...product information from online catalogs on a website. The aim here is quite straightforward; we need to gather and download catalogs to enrich our store's database. To further specify, the data in question include: - Product Images - Product Descriptions - Pricing Information - Category Details You will be tasked to focus on all categories available on the website. As such, proficiency in navigating various website blockades is a must. Your ability to deliver comprehensive, detailed, and accurate information in a well-structured format is crucial to this job. Prior experience in similar e-commerce web scraping projects would be a great advantage. Look forward to your bi...
I want to enlist the ass...enlist the assistance of an experienced web scraping developer, specifically in scraping data from Redfin. I'm primarily interested in the following data points: - Property address - Price - The number of bedrooms - The number of bathrooms This data will be used for personal reasons therefore respectful dealings with the website and its terms of service are obligatory. Here's the kicker, I don't just need you once. I'm wanting the data to be updated on a monthly basis, so I require a solution that's reliable in the long term. Ideal skills for this job are expertise in web scraping, familiarity with real estate websites particularly Redfin, and proficiency in language like Python, Beaut...
I need content scraped off a Dokuwiki for use...task is not recurring; it will require a single extraction that encompasses: - all the text content, - images, and - links. Ideally, the perfect candidate for this assignment will possess expertise or qualifying experience in web scraping. Knowledge on how to extract data from diverse formats will be beneficial. Proficiency in web scraping tools and techniques is a prerequisite. Once the content has been scraped successfully, I would appreciate if you can help arrange the data in a clear, accessible structure. Kindly ensure that while conducting the web scraping, the site’s terms of use are respected and that no harm comes to the website. The job is about finding, arranging, and extracting informatio...
...in need of a researcher/data scraper to help me source information for a project, the data will consist of surface level details about all of the current modular flight training schools in Europe and the UK. Here’s an example of some of the types of information about each school that will need to be obtained: - cost of training - duration of training - training facilities within the school - success rates - etc The main goal of this project is to obtain some relevant info about all of the modular pilot training facilities in Europe and the UK. Key Tasks: - Data scraping: you will be responsible for scraping data about flight schools - Data researching Ideal Skills and Experience: - Proven experience in data scraping...
...Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. T...
As a part of my market analysis project, I'm looking to scrape company profiles from the robotreport.com. This data will be crucial for understanding the market landscape and competitors within the robotics industry. Ideal Skills and Experience: - Proficiency in web scraping tools and techniques. - Experience in scraping data from news or business websites. - Understanding of the robotics industry would be a plus. - Ability to organize and present large amounts of data in a clear and concise manner.
I'm seeking an expert in data scraping who can gather menu items and prices from all restaurants listed on Hungerstation. Key Details: - Your task is to extract data specific to menu items and their respective prices. - The project spans all restaurants on the platform, not just specific ones or top-rated restaurants. - I need the final data to be organized and shared in an Excel file. Appropriate Skills and Experience: - Proficiency in data scraping - Strong attention to detail - Familiarity with Excel for data organization and delivery.
...high-performance APIs and programs using C#, .NET Core based on architecture frameworks and guidelines Prepare API Collection and Documentation Collaborate with external and internal teams to test and troubleshoot performance and functional issues Work towards DevOps model for continuous integration (CI) and continuous delivery/deployment (CD) pipelines Technical Skills: API developers should have comprehensive technical skills, including the following: Ability to work on protocols like HTTP, FTP and Web Sockets Ability to create APIs using REST pattern Knowledge of GraphQL and gRPC is an added advantage Knowledge of Web Services and understanding of service-oriented architecture (SOA) Proficiency with common API development frameworks/tools, including .NET Core 6+, MS ...
I need a script or program that can scrape data from a specific website and store user interactions in either a text file or a database. Specifically, I'm looking for the values of the buttons the user has clicked on the provided website - The goal of this data extraction is to customize user experience based on their interactions with the website. Key requirements for this project include: - Extracting the values from buttons on the website - Storing these values in an easily accessible format (text file or database) Ideal skills for this project would include: - Web scraping - Database management - Understanding of user experience customization Experience with similar projects and the ability to complete the work in a timely
2 Different assignments: (1) search for leads and email adresses for the german foundations. (2) Do data scraping from our Energy-consultans assignemnt
I am facing issues with my Node.js application, it isn't performing optimally. Specifically, the web scraping and automation features are flawed, causing inconvenient lag in functionality. The app crashes, performs slowly and sometimes displays incorrect data. I need you to scrape data from , as this function no longer works as intended. - Core Requirements: • Proficient in Node.js and debugging • Familiar with Web scraping methodology • Knowledge of web structure With your in-depth technical skills, I believe you can easily rectify these issues. Looking forward to your proposals.
...bringing to mind an image of dependability and expertise in wealth management Domain name availability: ".com" Domain should be available Ideal Skills and Experience of branding person: - Expertise in marketing and branding - Familiar with wealth management industry - Background in finance or related fields Responsibilities: - Create a brand name for Mobile Application that appeals to high net worth individuals - It must be original and memorable - The name should be short and should be easy to remember - It should reflect positivity and no negativity Industry: Financial planning, Wealth management, Investments, Insurance, Retirement, etc. Ultimately, I am aiming for a brand name that effectively reaches the sophisticated audience, and encapsulates the high lev...
I'm searching for a professional with experience in data scraping to extract availability details from a list of Airbnb properties. Interestingly, you will: - Collect availability information from the Airbnb calendar for each URL provided. - The data to be extracted pertains to the 'status of availability'(whether a property is booked or available). No further details are required. - Upon completion of scraping, the availability data should be compiled into an Excel file. Skills and Experience: - Proficient in data scraping specifically from websites like Airbnb - Familiarity with Excel formats - Exceptional attention to detail - Strong adherence to timeline and deadlines.
I require a good freelancer for a simple data scraping exercise. I require the freelancer to scrape information from a website. The data I require to be placed in columns within a spreadsheet is as follows:- Job Title Employer Address Salary Contract Type Closing Date Working Pattern Link to Job Job Summary Job Description Employers Website For questions about the job, contact: Team Name or Job Title Name Email address Phone Number Date Posted Pay Scheme Band Contract Duration Reference Number Job Locations I require approximately 5500 rows of data scraped. More work to follow if the quality of your work is good. Thanks,
I am in need of a freelancer who can assist me in the scraping of LinkedIn for the purpose of lead generation. The ideal candidate should be able to organize the data by industry and deliver the final dataset in CSV format. Key Requirements: - Efficiently scrape LinkedIn for specific industry - Organize the data by industry - Compile the final dataset in CSV format Ideal Skills and Experience: - Proficiency in web scraping, particularly LinkedIn - Ability to extract and organize data efficiently - Proficient in CSV file formatting - Understanding of lead generation needs and strategies Please provide examples of similar projects you have completed in the past, and let me know your approach to this task. I am looking for a freelancer who is detail-orien...
...seasoned marketing professional to assist in boosting the visibility of my share market services. The deliverables I'm expecting are: - Strategic Online Advertising: Implementation of targeted online advertising campaigns to attract potential investors from across the board. - Social Media Engagement: Proven expertise in managing and growing social media platforms to engage with retail investors, high-net-worth individuals, and institutional investors. - Door Step Marketing: Develop and execute a door step marketing strategy to further promote my services at a personal level. The main objective of this project is to increase brand and market awareness, which means that you should be well-versed in creating and executing comprehensive marketing plans. Ideal candidates shou...
scraping agents records from sales/queensland/brisbane-qld/agents aprx 5,460 agents
I'm on the lookout for an experienced developer who can assist me in finding Hidden APIs for two bookies. My goal is to scrape real-time data from both bookies. Key requirements include: - Data to be scraped: Odds and betting lines, Game schedules - Target: Real-time data scraping Ideal candidate should have experience in: - Web scraping - Uncovering Hidden APIs - Real-time data scraping Looking forward to hearing from professionals who've worked on similar projects and can ensure accurate and efficient data should be in puppeteer or beautiful soup but fast and also ability to load the games in game bid if you have done similar project before you can share sample for preview
I'm in need of a seasoned Python developer to create a program to scrape information from Telegram channels. The main purpose of this project is to: - Develop a Python program that can successfully extract all usernames from diverse Telegram channels. Given t...project is to: - Develop a Python program that can successfully extract all usernames from diverse Telegram channels. Given the nature of this project, it would be ideal if you possess extensive experience in Python programming. Understanding the operations and functionalities of the Telegram API is a prerequisite as well. This project requires a comprehensive grasp of web scraping principles and a consistent track record in data extraction tasks. Please bid if you are confident that you can deliver this Pytho...
Needs to hire 2 Freelancers Warning: No TIME WASTERS. Only working directly with Developers only No third parties or Sales Guy or CEO prohibited on this project: will be reported n case of violence: most of the bidders are just time wasters so please make sure you are not one of them Dum persons. thanks we are looking Expert in Vue JS - Front End - Web API .Net core and good knowledge of handling web of Vue.js 2 and Vue.js expert level experience this gonna be a long term project for a right and skilled dev we are looking, so no time wasters please bid only if you are skilled full because technical screening will be done before hiring over here. we have project just started and right candidate expectation is to grasp and get going on it we are easy going company and only required ...
I am looking for a Python experienced person capable of creating a web scrapper that can extract text content from Aliexpress and then categorize these extracted data into a Google Sheet in a specific format. Crawler in python format. Thanks. Please provide a sample
I need a freelancer to scrape text data from a PDF and output it into separate cells by paragraph in an Excel document. Key Requirements: - Extract and convert text data from a PDF into a structured Excel file. - Each paragraph should be in a separate cell in the Excel sheet. Ideal Skills and Experience: - Proficiency in PDF scraping and Excel data entry. - Attention to detail to ensure accurate data transfer. - Understanding of text formatting to ensure the data is organized accordingly in the Excel sheet.
I'm looking for a skilled lead scraper with prior experience in compiling lists of law firms. The ideal candidate should have: - Proficiency in lead scraping - Prior experience in compiling lists of law firms, especially in California - Ability to gather and organize the following information from each law firm: - Law firm name - Contact person's name - Email address - Website - Physical address - Phone number of the contact person - Phone number of the law firm The project will involve the compilation of three CSV lists, each focusing on a different niche within law firms - Family law, Personal Law, and Criminal law. In total, the completed lists should contain approximately 100-500 leads each. The leads should be based in California, USA. ...
I am seeking a freel...application should identify and clearly highlight any price differences. - An intuitive interface that enables easy viewing and understanding of the price comparisons is preferred. - The ability to handle with cases such as CAPTCHA, implementing delays upon request, and to avoid being blocked. It would really help if you have prior experience in the e-commerce sector along with skills in web scraping, data mining, and automation. Familiarity with APIs of popular e-commerce platforms like Amazon, eBay, or Alibaba will be considered a distinct advantage. The ultimate goal is to create a tool that helps me simultaneously keep track of various product prices, identify the best deals available, and make informed purchasing decisions. Let's help shopper...
I am currently valiantly battling with a multitude of issues with my .NET Core API, and I require the help of a seasoned professional. In need of someone who is proficient at: - Troubleshooting and fixing authentication errors: I am routinely encountering authentication issues which is deeply affecting usability. - Enhancing data consistency: I have been observing a distressing amount of data inconsistencies that need rectifying. - Implementing user registration and authentication: I need to provide my users with a smooth registration and login process to enhance platform accessibility. - Building data validation and error handling mechanisms: My API is in dire need of solid data validation and error handling procedures to increase reliability. - Integra...
I'm looking for a web scraping expert to build two scrapers for sports betting odds data. Key Requirements: - Scraping sports data from two sources - Building two separate scrapers - Implementing additional functions as required - Well structured code with scalability in focus I'm looking for someone who: - Has strong experience with web scraping, especially for sports data - Can deliver a reliable and efficient solution - Has an understanding of sports betting odds data - Is commited to deadlines
I'm seeking a highly skilled fullstack developer who is proficient in PHP, .NET, and especially SQL for diverse web application projects. Your primary role will be equal focus on both front-end and back-end development on multiple platforms, including WordPress and PHP. Mandated Features: * Database Integration - Structuring, optimizing, and ensuring smooth functioning of databases within applications. * API Integration - Implementing third-party APIs comprehensively. Ideal Skills and Experience: * Proficient in PHP, .NET, and SQL. * Strong experience with WordPress. * Proven full-stack capabilities. * Expertise in Database and API integration. * Good problem-solving abilities and attention to detail. We're expecting high quality work with minimal supervision....
I need a web scraper for Website 2, specifically to extract product details on a daily basis. Key Requirements: - Web scraping tool to extract product details from Website 2 - Automation to carry out the process on a daily basis Ideal Freelancer: - Proficient in web scraping with experience in similar projects - Knowledge of automation tools - Able to deliver a reliable and efficient solution
I am looking for an expert in data scraping who can meticulously extract textual data from blogs for me. Tasks: - You will be asked to scrape textual data from specific blogs - Collect not just the core content, but also the associated links Skills and Experience required: - Expertise in Data scraping, preferably in blog spaces - Experience working with multiple data formats, mainly text and link data - Remarkable attention to detail - Ability to work with minimal supervision and adhere to deadlines. If you can deliver accurate and thorough results, I invite you to place your bid.
This is a similar data scraping job as our previous one! I will send details and specifics. Please reach out or call if you have any questions. The deadline is May 19th at 12pm. There will be additional incentives for generating additional leads.
...manipulation on any account. Manipulation includes but not limited to: Tick scalping – constantly opening and closing trades in less than 30 seconds. We realise sometimes trades are closed instantly for one reason or another, so if there are occasional trades that are opened and closed in less time we won’t close your account. Arbitrage. Hedging between accounts. Delayed or frozen data feeds. Unrealistic fills that don’t take into account slippage, where a huge lot size is used and closed within a small amount of pips. Allowing others to trade your account. Copying others trades. Lot size manipulation – Traders cannot use a much smaller trade to pass the minimum days after hitting the profit target or to fill the minimum t...
Looking for an experienced web scraper to extract the followers count data from Twitter user profiles as quickly as possible. Your task is to build a simple and efficient scraper specifically designed for this purpose. reply with header %fdri30 so i can understand you are not a bot.. the scrapper will read the user names from file the format is like this Swan;; We are witnessing the Bitcoin Gold Rush. #Bitcoin;; 2024-05-12 15:35:18 Vivek4real_;; The simplest explanation of why we need #Bitcoin;; 2024-05-12 13:13:51 script will edit the file and add each user's followers count to end of line like this so the logic shouold be to add at the end of each line, the columns order can change...but as long as it adds at the end of each line it is perfect Swan;; We are witnessing
I need a skilled network specialist to set up a single VPN tunnel between two routers using OpenVPN. The routers are both GL Net routers: the flint GL-AX1088 router and the GL - A1300-370 router. The main router on my server is the Lynksys Mesh router on a Gigaclear service provider. The main purpose of this VPN tunnel is to ensure secure data transfer between the two routers. in different countries. Key details: - The routers are using the DD-WRT operating system. Experience with this system is highly desirable. - Beyond the VPN tunnel, no additional security features need to be configured. Ideal skills for this job include: - Proficiency with OpenVPN and setting up secure VPN tunnels. - Experience in configuring routers, especially those running DD-WRT operating sys...
...focus on measuring investment performance, assessing risk and return, as well as tracking portfolio growth. Key Requirements: - Develop metrics for Return on Investment (ROI), Internal Rate of Return (IRR), Cash Multiple, and Net Asset Value (NAV). - Multiple on Invested Capital (MOIC Metric) - Gross Total Value to Paid in Capital (Gross TVPI Metric) - Net Total Value to Paid in Capital (net TVPI Metric) - Residula Value Per Paid In Capital (RVPI Metric) - Distributions per Paid In Capital (DPI Metric) - Gross IRR Metric - Gross Realized IRR Metric - Net IRR Metric - Net Realized IRR Metric - Revenue - Lifetime Value of a Customer (LTV) - Unit Economics - These metrics should be calculated on a quarterly basis. Ideal Candidate: - Experience in financ...
I need a skilled professional to scrape specific data from various websites for my project. Hi here is this website it updates its data every minute, the data is in format of a table with 10 cells Each cell has one of the two variables (big or small) Same can be seen in the screenshot. I need to scrap 10 of these big/small variables
I'm in need of a web scraping expert who can extract daily car rental prices from and deliver this data to me in Excel format. Key Requirements: - Extract car rental prices from - US based locations - Deliver the scraped data in Excel format Ideal Skills and Experience: - Proficient in web scraping - Experience in extracting data from dynamic websites like - Able to automate daily data extraction - Proficient in delivering data in Excel format
I need a skilled data scraper to help me collect seller information from e-commerce websites. Here's what I'm looking for: - Expertise: You should have previous experience in data scraping, particularly with e-commerce websites. - Attention to detail: It's crucial that the information collected is accurate and complete. - Communication: You should be able to provide regular updates on the progress of the project. I'm looking to automate this process, so any prior experience with web scraping tools or programming languages will be a big plus.
I'm looking to hire a freelancer who can construct a UI Vision Simple Script for web automation. The main pur...looking to hire a freelancer who can construct a UI Vision Simple Script for web automation. The main purpose is to automate repetitive tasks, specifically focusing on web scraping. As this task involves browser interaction, the ideal candidate should have a keen understanding and profound experience in scripting for web automation on various browsers. Key responsibilities: - Develop a UI Vision Script for automation - Concentrate on web scraping to extract relevant data - Provide advice on effective methods for web automation To perform this task effectively, skills and experience in JavaScript, Selenium, and web scraping are highly desir...
