DMM ingestion fails with 'Expected numeric, but found only non-numeric values for column X'

Version/Environment (if relevant):

Domino 4.6, 5.0, 5.1, 5.2 

Issue:

DMM ingestion may fail with warnings in the Ingestion logs

Checking the log for the dmm-compute pod you may find errors similar to the following:

"message":"Found errors: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 4 times, most recent failure: Lost task 0.3 in stage 0.0 (TID 3, 172.17.3.116, executor 0): org.apache.spark.sql.AnalysisException: Parquet type not supported: INT32 (UINT_8)

Root Cause:

The Domino versions noted above use spark v3.0.2 which does not support uint8/16/32.  If you attempt to use this data type the data ingestion will fail as noted above.  See article here for details:

https://issues.apache.org/jira/browse/SPARK-34817

Resolution:

To work around this problem do not use these data types.  At Domino v5.3 we have upgraded to spark v3.2 which does support these data types.