Python for Data Science | April 04,2020 - May 09,2020 |Rajneesh

Discussion in 'Big Data and Analytics' started by Mohammed Nayeemulla S, Apr 4, 2020.

  1. Rajaneesh_2

    Rajaneesh_2 Active Member

    Joined:
    Aug 24, 2019
    Messages:
    25
    Likes Received:
    4
    #51
  2. SHEETAL SAHU

    SHEETAL SAHU Member

    Joined:
    Mar 27, 2020
    Messages:
    4
    Likes Received:
    0
    hello Rajneesh sir,
    i am having doubt from matrix factorisation i m stuck there can u pls help me .
    can i convert the dataframe to matrix?
    i am not understanding
     
    #52
  3. SHEETAL SAHU

    SHEETAL SAHU Member

    Joined:
    Mar 27, 2020
    Messages:
    4
    Likes Received:
    0
    in amazon project
     
    #53
  4. Aditya Uddandam

    Aditya Uddandam New Member

    Joined:
    Mar 23, 2020
    Messages:
    1
    Likes Received:
    0
    The means of the average response time across complaint types is 82% similar, can i accept Null Hypothesis ?? or it has to be 100% similar ??
     
    #54
  5. Manish kumar singh_11

    Joined:
    Apr 3, 2020
    Messages:
    5
    Likes Received:
    0
    sir, regarding nyc project
    8. Statistical test for the average response time across complaint types is similar or not-


    data.dropna(subset=['Request_closing_time'],how='any',inplace=True)
    // taking any three random Comlaint_type
    agency_issue=data[data.Complaint_Type=='Agency Issues']
    animal_abuse=data[data.Complaint_Type=='Animal Abuse']
    illegal_firework=data[data.Complaint_Type=='Illegal Fireworks']

    f_oneway(agency_issue.Request_closing_time,animal_abuse.Request_closing_time,illegal_firework.Request_closing_time)

    i am getting output-
    F_onewayResult(statistic=6.770120839427416, pvalue=0.0011541927966116955)

    on other side if i am trying-
    //by head () method i am taking values manually from dataset by filtering Complaint_type
    Agency_Issues=[27120,37380,9720,24720,4020,10620]
    Animal_Abuse=[1560,4260,8100,9600,4260,15300,3360,13320,6000,26820]
    Illegal_Fireworks=[1140,43560,5400,1500,11700,960,1140]
    f_oneway(Agency_Issues,Animal_Abuse,Illegal_Fireworks)

    my output is-
    F_onewayResult(statistic=1.4747769182277108, pvalue=0.25267221557695146)

    why i am getting different pvalues??
     
    #55
  6. Manish kumar singh_11

    Joined:
    Apr 3, 2020
    Messages:
    5
    Likes Received:
    0
    ## 9. Declaring Null Hypothesis or Alternate Hypothesis for the type of complaint or service requested and location related

    data.groupby('City').Complaint_Type.describe()

    is it right way??
     
    #56
  7. Amarshree V

    Amarshree V Active Member
    Alumni

    Joined:
    Feb 17, 2020
    Messages:
    20
    Likes Received:
    4
    Thank you sir,
    I have other doubt which I have attached below.
    I calculated the complaints closed and open how to convert the same to percentage ? is there any predefined function to do the same?
     

    Attached Files:

    #57
    Last edited: May 10, 2020
  8. Sangita Pandey

    Joined:
    Mar 12, 2020
    Messages:
    2
    Likes Received:
    0
    ## 9. Declaring Null Hypothesis or Alternate Hypothesis for the type of complaint or service requested and location related
    **Hint :** This task is similar to the gender and spending co-relation example we looked in stats class.

    Which lecture are you referring to? Please advise.
     
    #58
  9. PRAJITH C

    PRAJITH C New Member

    Joined:
    Mar 29, 2020
    Messages:
    1
    Likes Received:
    1
    #10. Statistical test for the type of complaint or service requested and location related

    Can someone guide me on this
     
    #59
    Daniel Olili likes this.
  10. Shalinee

    Shalinee Member

    Joined:
    Apr 3, 2020
    Messages:
    6
    Likes Received:
    0
    Can some help me with this error:
    upload_2020-5-11_21-1-42.png
     

    Attached Files:

    #60
  11. Okram Hemanta Singh

    Joined:
    Nov 26, 2019
    Messages:
    3
    Likes Received:
    0
     
    #61
  12. Okram Hemanta Singh

    Joined:
    Nov 26, 2019
    Messages:
    3
    Likes Received:
    0
    I have pick up the same project... Hope we can help each other
     
    #62
  13. Amarshree V

    Amarshree V Active Member
    Alumni

    Joined:
    Feb 17, 2020
    Messages:
    20
    Likes Received:
    4
    For me only this part is remaining. Have u Done calculating percentage?
     
    #63
  14. Pooja Arora

    Pooja Arora Member

    Joined:
    Nov 6, 2019
    Messages:
    5
    Likes Received:
    0
    Can you check your column names..? i think the dataset has column names as Closed Date and Created Date (no underscore) unless u renamed them.
     
    #64
  15. Shalinee

    Shalinee Member

    Joined:
    Apr 3, 2020
    Messages:
    6
    Likes Received:
    0
    Thanks Pooja. Now its working . Please help me if i need any help.
     
    #65
  16. Gaanashree S Patil_1

    Gaanashree S Patil_1 Administrator
    Alumni

    Joined:
    Dec 31, 2019
    Messages:
    13
    Likes Received:
    8
    Hi Abhishek!

    1. Python allows you to read, write and delete files.
    2. Use the function open("filename","w+") to create a file. ...
    3. To append data to an existing file use the command open("Filename", "a")
    4. Use the read function to read the ENTIRE contents of a file.
    5. Use the readlines function to read the content of the file one by one.
     
    #66
  17. Sudip Chakraborty_1

    Joined:
    Feb 28, 2020
    Messages:
    3
    Likes Received:
    0
    Hi,

    genres = master_data[['Title', 'Genres']]---->Creating Title & Genres column
    genres['Genres'] = genres['Genres'].apply(lambda x: x.split('|'))---->splitting the genres
    genres_list = genres.Genres.tolist()--->convert into list
    unique_genres1 = set(functools.reduce(operator.concat, genres_list[:50000]))----->convert into set

    But last command execution is possible only for 50K entries & total 1mn entries consist...so i have to execute last command 20 times...Pls help me to do the right approach...
     
    #67
  18. Shalinee

    Shalinee Member

    Joined:
    Apr 3, 2020
    Messages:
    6
    Likes Received:
    0
    I am getting error for cross tab:As i have given the same name whats there when data has imported:
    upload_2020-5-18_0-24-4.png
     
    #68
  19. Okram Hemanta Singh

    Joined:
    Nov 26, 2019
    Messages:
    3
    Likes Received:
    0
    Sorry I have not visited the forum again as I submitted my project on 12th. I hope you must have also submitted. Finger crossed... our projects will be approved.....we have done best of us....
     
    #69
  20. Monalisa Saha

    Monalisa Saha Member

    Joined:
    Feb 12, 2020
    Messages:
    2
    Likes Received:
    0
    can you try the code like this: type(tab) in the next line instead of using the type in the same line just break it. Don't know either your purpose will serve or not.
     
    #70

Share This Page