Willingness to contribute

Yes. I can contribute a fix for this bug independently.

Feathr version

0.8.0

System information

• OS Platform and Distribution (e.g., Linux Ubuntu 20.0): Linux Ubuntu 20
• Python version: 3.10
• Spark version, if reporting runtime issue:

Describe the problem

_PreprocessingPyudfManager._parse_function_str_for_name has a bug so that if the udf function includes type hint, it parses wrong function name.

Tracking information

No response

Code to reproduce bug

def preprocessing(df: DataFrame) -> DataFrame:
    import pyspark.sql.functions as F
    df = df.withColumn("fare_amount_cents", (F.col("fare_amount") * 100.0).cast("float"))
    return df

then run

client.register_features()
client.get_features_from_registry()

What component(s) does this bug affect?

• Python Client: This is the client users use to interact with most of our API. Mostly written in Python.
• Computation Engine: The computation engine that execute the actual feature join and generation work. Mostly in Scala and Spark.
• Feature Registry API: The frontend API layer supports SQL, Purview(Atlas) as storage. The API layer is in Python(FAST API)
• Feature Registry Web UI: The Web UI for feature registry. Written in React