Read excel spark

    import org.apache.spark.sql._

val spark: SparkSession = ???
val df = spark.read
         .format("com.crealytics.spark.excel")
        .option("sheetName", "Daily") // Required
        .option("useHeader", "true") // Required
        .option("treatEmptyValuesAsNulls", "false") // Optional, default: true
        .option("inferSchema", "false") // Optional, default: false
        .option("addColorColumns", "true") // Optional, default: false
        .option("startColumn", 0) // Optional, default: 0
        .option("endColumn", 99) // Optional, default: Int.MaxValue
        .option("timestampFormat", "MM-dd-yyyy HH:mm:ss") // Optional, default: yyyy-mm-dd hh:mm:ss[.fffffffff]
        .option("maxRowsInMemory", 20) // Optional, default None. If set, uses a streaming reader which can help with big files
        .option("excerptSize", 10) // Optional, default: 10. If set and if schema inferred, number of rows to infer schema from
        .schema(myCustomSchema) // Optional, default: Either inferred schema, or all columns are Strings
        .load("Worktime.xlsx")

Source: stackoverflow.com

Read excel spark

def readExcel(file: String): DataFrame = sqlContext.read
    .format("com.crealytics.spark.excel")
    .option("location", file)
    .option("useHeader", "true")
    .option("treatEmptyValuesAsNulls", "true")
    .option("inferSchema", "true")
    .option("addColorColumns", "False")
    .load()

val data = readExcel("path to your excel file")

data.show(false)

Source: stackoverflow.com

Similar codes

0 vote266 views1 answer
I want to add a new column to the DataFrame containing only the month of the measurement
Python
1 vote222 views1 answer
Matplotlib ax.annotate color of the arrow
Python
68 votes216 views4 answers
How to define main in python
Python
-1 vote230 views2 answers
Scaling
Python
2 votes183 views1 answer
Displaying flash message django
Python
0 vote188 views1 answer
Pandas read_csv multiple separator
Python
1 vote198 views1 answer
Print console sys.stdout
Python
0 vote213 views1 answer
How to convert datasets into pandas dataframes
Python
1 vote181 views2 answers
Pandas repeat rows n times
Python
0 vote193 views1 answer
Train_test_split from sklearn.selection
Python