February 21, 2025 • Tips PySpark • Bartosz Konieczny
To see Apache Spark logs, you need to set the log level before running the transformations. The following snippet will enable trace logs to the console:
spark_session.sparkContext.setLogLevel('TRACE')
privacy policy © 2014 - 2025 waitingforcode.com. All rights reserved | Design: Jakub Kędziora