can any one help with this question Create a new...

Discussion in 'Big Data and Analytics' started by rupesh_6, Jun 26, 2017.

  1. rupesh_6

    rupesh_6 New Member

    Joined:
    Feb 16, 2016
    Messages:
    1
    Likes Received:
    0
    can any one help with this question

    Create a new data set with exponential, cube, squared, and log values for each variable
     
    #1
  2. Megha_42

    Megha_42 Well-Known Member
    Simplilearn Support

    Joined:
    Dec 15, 2016
    Messages:
    206
    Likes Received:
    9
    Hi Rupesh,

    As I understand, the question asks you to convert every number from the number_column to covert into a row of exp,cube,sq, and log values.
    Spark has inbuilt functions that you can use for these purposes. Please go through the Spark documentation of one such function for log,

    https://spark.apache.org/docs/1.6.2...nctions.html#log(org.apache.spark.sql.Column)

    To do this, you will have to create a dataframe that contains the numerical columns, and then proceed with applying the functions on the dataframe.

    All the very best!
     
    #2
  3. _6230

    _6230 Well-Known Member
    Alumni

    Joined:
    Apr 4, 2017
    Messages:
    185
    Likes Received:
    8
    thanks could you ellobrate bit more. not able to understand from the document.
     
    #3

Share This Page