Hi My name is Amit and im currently diving into Datascience using python and wanted to learn more data profiling using pandas and would like a base profiler which i can use and then extend.
My requirements are below.
Create a python data profiling tool with the following features:
The data profiling tool should enable the user to either individually or on mass action the following:
1. Specify a particular data frame
2. Specify a particular column and generate basic statistical information and visuals for that column, i.e., histograms, pareto plots etc.
3. Specify a particular column and generate statistical information about how that column varies over a specified time window. For example, we might be interested in knowing how the distribution in the ‘Number_of_Casualties varies by day, week or month for a given dataframe.
Dataset - One or more of the road safety data csv files from 2015/16/17/etc., should be used as an example. See data link here: [login to view URL]
Creating a complete profiling package could take a long time and is not expected as there are multiple issues to contend with regarding data type and quality.
Instead the idea here is to demonstrate the ‘potential’ for a data profiling tool to aid ML workflows. The focus should be on creating a clear minimal viable product for demo purposes in order guide future development.
Work should demonstrate:
- Good coding practise
- Presence of unit, integration and acceptance tests
- Use of class methods
Results should include:
- Documentation highlighting what the profiling tool does and how to execute it. It should also highlight its scope, scalability/limitations and future features that could be considered for development.
- Documentation regarding func/class methods inputs/outputs should also be available in sphinx.
19 freelancers are bidding on average £150 for this job
Hi there, please leave a message on my chat so we can discuss the budget and deadline of the project. I have read your project description and i'm confident i can do this project for you perfectly. Thanks . .
*****Hello, dear!!!***** I have read your description carefully. I can handle it with full confidence and have already done this type of projects. Please give me an opportunity to work with you.