KafkaUtils module not found on spark 3 pyspark

[Serafim]

THis can be read on spark.apache.org concerning Kafka integration in Spark 3.0.1:

The Spark Streaming integration for Kafka 0.10 provides simple parallelism, 1:1 correspondence between Kafka partitions and Spark partitions, and access to offsets and metadata. However, because the newer integration uses the new Kafka consumer API instead of the simple API, there are notable differences in usage.

and that's just the start of it...