
Type "help", "copyright", "credits" or "license" for more information.Ģ0/09/09 22:52:46 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform. Type in expressions to have them evaluated. It can easily process and distribute work on large datasets across multiple computers.

It is designed with computational speed in mind, from machine learning to stream processing to complex SQL queries. Using Scala version 2.12.10 (OpenJDK 64-Bit Server VM, Java 11.0.8) What is Apache Spark Apache Spark is a distributed open-source, general-purpose framework for clustered computing. Conventions requires given linux commands to be executed with root privileges either directly as a root user or by use of sudo command requires given linux commands to be executed as a regular non. Spark context available as 'sc' (master = local, app id = local-1599706095232). Red Hat Enterprise Linux 8: Software: Apache Bench 2.3: Other: Privileged access to your Linux system as root or via the sudo command. To adjust logging level use sc.setLogLevel(newLevel). Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties using builtin-java classes where applicable WARNING: All illegal access operations will be denied in a future releaseĢ0/09/09 22:48:09 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform. WARNING: Use -illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: Please consider reporting this to the maintainers of .Platform WARNING: Illegal reflective access by .Platform (file:/opt/spark/jars/spark-unsafe_2.12-3.0.1.jar) to constructor (long,int)

WARNING: An illegal reflective access operation has occurred
