PySpark
keyboard_arrow_down 147 guides
chevron_leftPySpark SQL Functions
Method arrayMethod colMethod collect_listMethod collect_setMethod concatMethod concat_wsMethod countMethod count_distinctMethod countDistinctMethod date_addMethod date_formatMethod dayofmonthMethod dayofweekMethod dayofyearMethod element_atMethod explodeMethod exprMethod firstMethod greatestMethod instrMethod isnanMethod lastMethod leastMethod lengthMethod litMethod lowerMethod maxMethod meanMethod minMethod monthMethod regexp_extractMethod regexp_replaceMethod repeatMethod roundMethod splitMethod to_dateMethod translateMethod trimMethod upperMethod whenMethod year
check_circle
Mark as learned thumb_up
0
thumb_down
0
chat_bubble_outline
0
Comment auto_stories Bi-column layout
settings
PySpark SQL Functions | trim method
schedule Aug 12, 2023
Last updated local_offer
Tags PySpark
tocTable of Contents
expand_more Master the mathematics behind data science with 100+ top-tier guides
Start your free 7-days trial now!
Start your free 7-days trial now!
PySpark SQL Functions' trim(~) method returns a new PySpark column with the string values trimmed, that is, with the leading and trailing spaces removed.
Parameters
1. col | string
The column of type string to trim.
Return Value
A new PySpark Column.
Examples
Consider the following PySpark DataFrame:
+---------+---+| name|age|+---------+---+| Alex | 20|| Bob| 30||Cathy | 40|+---------+---+
Here, the values in the name column have leading and trailing spaces.
Trimming columns in PySpark
To trim the name column, that is, to remove the leading and trailing spaces:
Here, the alias(~) method is used to assign a label to the Column returned by trim(~).
To get the original PySpark DataFrame but with the name column updated with the trimmed version, use the withColumn(~) method:
+-----+---+| name|age|+-----+---+| Alex| 20|| Bob| 30||Cathy| 40|+-----+---+
Published by Isshin Inada
Edited by 0 others
Did you find this page useful?
thumb_up
thumb_down
Comment
Citation
Ask a question or leave a feedback...
Official PySpark Documentation
https://spark.apache.org/docs/3.1.1/api/python/reference/api/pyspark.sql.functions.trim.html
thumb_up
0
thumb_down
0
chat_bubble_outline
0
settings
Enjoy our search
Hit / to insta-search docs and recipes!
