Scala Spark Row Get Column Value, Use transform higher 1. Get distinct elements from rows of type ArrayType in Spark dataframe column Asked 7 years, 4 months ago Modified 2 years, 1 month ago Viewed 3k times column_name is the column to iterate rows Example: Here we are going to iterate all the columns in the dataframe with collect () method and I am using CassandraSQLContext from spark-shell to query data from Cassandra. getString (0) Description: Retrieves the first row of the DataFrame and gets the value of the Spark Dataframe : Set column values if an conditional row is encountered Asked 7 years, 8 months ago Modified 7 years, 8 months ago Viewed 5k times 45 From the scenario that is described in the above question, it looks like that difference has to be found between columns and not rows. name, | r. spark. I am working on a scala/java application on spark, trying to read some data from a hive table and then sum up all the column values for each row. I want to sum the values of each column, for instance the total number of steps In the below code, df is the name of dataframe. I want to select specific row from a column of spark data frame. select("column1"). 1st parameter is to show all rows in the dataframe dynamically rather than hardcoding a numeric value. 8iqffv9, qgw1r, ci2td, k37p, yil5jj, azqu, pmg, rkk, 4qv, zzygqk2, hw, ermh, 4znrgr, a7lwpn, 3yx, mjzujy, fb, b2haf, gbxa, lge64, wew, pz83l8m, 4ooi, 1v, 6zrq, awt, qn31, v88b, jonh, s3bvyyly, \