menu

login

Log in

Linear Algebra

Prob and Stats

Other math topics

Machine Learning

Dagster (NEW)

search

Search

Login

Unlock 100+ guides

menu

menu

search toc

close

Outline

Parameters Return Value Examples Getting the keys of a pair RDD in PySpark

Comments

Log in or sign up

Cancel

Post

account_circle

exit_to_app

Sign out

What does this mean?

Why is this true?

Give me some examples!

search

keyboard_voice

close

Searching Tips

Search for a recipe:
"Creating a table in MySQL"

Search for an API documentation: "@append"

Search for code: "!dataframe"

Apply a tag filter: "#python"

Useful Shortcuts

/ to open search panel

Esc to close search panel

↑↓ to navigate between search results

⌘d to clear all current filters

⌘Enter to expand content preview

icon_star

Doc Search

icon_star

Code Search Beta

SORRY NOTHING FOUND!

mic

Start speaking...

Voice search is only supported in Safari and Chrome.

fullscreen_exit

Shrink

Navigate to

PySpark

147 guides

keyboard_arrow_down

Linear Algebra

Prob and Stats

Machine Learning

Other math topics

chevron_leftPySpark RDD

Method coalesce Method collect Method collectAsMap Method count Method countByKey Method filter Method first Method getNumPartitions Method glom Method keys Method map Method partitionBy Method reduceByKey Method repartition Method zip Method zipWithIndex

check_circle

Mark as learned

thumb_up

2

thumb_down

0

chat_bubble_outline

0

Comment

auto_stories Bi-column layout

settings

PySpark RDD | keys method

schedule Aug 12, 2023

Last updated

local_offer

PySpark

Tags

tocTable of Contents

expand_more

Parameters Return Value Examples Getting the keys of a pair RDD in PySpark

Master the mathematics behind data science with 100+ top-tier guides
Start your free 7-days trial now!

PySpark RDD's keys(~) method returns the keys of a pair RDD that contains tuples of length two.

Parameters

This method does not take in any parameters.

Return Value

A PySpark RDD (pyspark.rdd.PipelinedRDD).

Examples

Consider the following PySpark pair RDD:


        
        
            
                
                
                    # Create a RDD using the parallelize method
rdd = sc.parallelize([("a",3),("a",2),("b",5),("c",1)]) 
rdd.collect()
                
            
            [('a', 3), ('a', 2), ('b', 5), ('c', 1)]

Getting the keys of a pair RDD in PySpark

To get the keys of the pair RDD as a list of strings:


        
        
            
                
                
                    rdd.keys().collect()
                
            
            ['a', 'a', 'b', 'c']

Note that if the RDD is not a pair RDD, then the values are returned:


        
        
            
                
                
                    rdd = sc.parallelize(["a","a","b","c"]) 
rdd.collect()
                
            
            ['a', 'a', 'b', 'c']

robocat

Published by Isshin Inada

Edited by 0 others

Did you find this page useful?

thumb_up

thumb_down

Comment

Citation

Ask a question or leave a feedback...

Official PySpark Documentation

https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.RDD.keys.html

thumb_up

2

thumb_down

0

chat_bubble_outline

0

settings

Enjoy our search

Hit / to insta-search docs and recipes!

Navigation

Contact us

Resources

Python Pandas MySQL Beautiful Soup Matplotlib NumPy PySpark

Community

Join our Discord

Join our newsletter for updates on new comprehensive DS/ML guides

|