Closed

Shodan api scraping/parser script

Need a small script written, which will run in loops.

The basic Shodan api Command-Line Interface (shodan download --limit xx "search quiery" , shodan parse --fields ip_str,port) is to be used, so I can easily adjust, should my needs change.

So, here's the scenario:

On each run, the script will pull the latest xx results for the "search quiery" with Shodan api, extracts the necessary data, and buffers them in [url removed, login to view]

Then, the script probes every entry in the list with "curl ip:port" command which is expected to return

<?xml version=.........

...........

..........

</html>

The script checks if the returned data precisely matches the template, predefined within the script (which I'm should be able to modify, if needed) and if the match is precise, the ping considered "successful" and the particular entry ip:port ( one entry per line) is exported into 2 lists:

The first one is [url removed, login to view], which will be erased, upon the cycle completion and recreated on the next run.

Second list is [url removed, login to view], which will contain all time successfully pinged ip:port entries:

ip1:port

ip2:port

...

ipx:port

If the ip:port curl probe doesn't return the expected template predefined value, it is saved into [url removed, login to view]

Upon the next script cycle it pulls the latest xx results with Shodan api extract the necessary ip:port data, buffers them in the recreated [url removed, login to view] and compares against the [url removed, login to view] and [url removed, login to view] entries.

If the new ip:port entries are found, they are probed again with "curl ip:port" command, the successful entries are exported into [url removed, login to view] again and also added to the database.txt.

The unsuccessful entries are added into [url removed, login to view], as per previous cycle.

Then all repeats again...

Skills: Bash Scripting, PHP, Python, Web Scraping

See more: need small script, need small script php, need small fix script, php, python, web scraping, need scraping script, free scraping php script, pagerank script need database, shopzillacom api partner site script, rss parser script, php parser script, html parser script, shoppingcom api web services script, parser script xml odds feed football, html php parser script, yahoo api kelkoo php script, api weather script, need resume written, scraping script

About the Employer:
( 3 reviews ) Narva, India

Project ID: #16394364

4 freelancers are bidding on average $44 for this job

whitehorsetechn

Greeting, I have understood your Shodan api scraping/parser script task and can do it with your 100% satisfaction. Please ping me for more discussion. I have more than 5 years of experience in Bash Scripting, PH More

$50 USD in 1 day
(14 Reviews)
4.9
DanielGordi

Hello There, It seems you need a health check script, I can help you with this project. If you're interested, Please let me know. Best Regards, Daniel Gordi

$50 USD in 1 day
(4 Reviews)
2.7
mikhailkozalski

Hi, How are you? If you trust me ,I 'll do my best for you and my reputation. Please let's discuss more detail in this chat. Thanks for your attention.

$30 USD in 1 day
(2 Reviews)
2.8
Grani5

A proposal has not yet been provided

$46 USD in 1 day
(0 Reviews)
0.0