Attribute Cookbook

• Adding a new attribute in Beautiful Soup
  To add a new attribute in Beautiful Soup, we can directly assign the new value.
• Deleting an attribute in Beautiful Soup
  To delete an attribute in Beautiful Soup, use the del keyword.
• Extracting attribute values in Beautiful Soup
  To extract attributes of elements in Beautiful Soup, use the [~] notation. For instance, el["id"] retrieves the value of the id attribute.
• Finding all links in Beautiful Soup
  To find all links (i.e. elements with the a tag) in Beautiful Soup, use the find_all method.
• Updating an attribute in Beautiful Soup
  To update an attribute in Beautiful Soup, we can directly reassign the value.

Finding elements Cookbook

• Finding elements by attribute in Beautiful Soup
  To find elements by attribute in Beautiful Soup, us the select(~) method or the find_all(~) method.
• Finding elements by class in Beautiful Soup
  To find elements by class in Beautiful Soup use the find_all(~) or select(~) method.
• Finding elements by id in Beautiful Soup
  To extract elements by id in Beautiful Soup: use the find_all(~) method with argument id or use the select(css_selector) method.
• Finding elements by tag name in Beautiful Soup
  To extract multiple elements by tag name, we could use either the methods find_all(tag_name) or the select(tag_name), both of which return a list of elements with the specified tag.
• Finding elements that are direct descendants in Beautiful Soup
  To find elements that are direct descendants in Beautiful Soup, use the find_all(~) method, passing through recursive=False.
• Finding elements that contain a specific text in Beautiful Soup
  To find elements that contain a specific text in Beautiful Soup, we can use find_all(~) method together with a lambda function.
• Finding elements that contain all the specified classes in Beautiful Soup
  To find elements that contain all the specified classes in Beautiful Soup use the soup.select(~) method with the CSS selector to filter for multiple classes.
• Finding elements that only contain specific attributes and no other attributes in Beautiful Soup
  To find all elements that only contain the "gender" attribute and no other attributes, define a custom filter function.
• Finding elements using regular expression in Beautiful Soup
  To find elements using regular expression, use the find_all(~) method and pass in the regular expression for the text parameter.
• Limiting the number of returned results in Beautiful Soup
  To limit the number of returned results in Beautiful Soup, set the limit parameter of the find_all method.

Miscellaneous Cookbook

• Checking current version number of Beautiful Soup
  To check the version number of your Beautiful Soup, run bs4.__version__.
• Difference between methods findAll and find_all in Beautiful Soup
  As of 2016 in Beautiful Soup, the method findAll has been renamed as find_all. For this reason, opt to use find_all over findAll.
• Pretty-printing in Beautiful Soup
  To pretty-print in Beautiful Soup, use the prettify() method.
• Testing NavigableString or Tag objects for equality in Beautiful Soup
  In Beautiful Soup, two NavigableString or Tag objects are considered to be equal if the underlying HTML is identical.

Parent and Children Cookbook

• Accessing an element's parent in Beautiful Soup
  To access an element's parent in Beautiful Soup, use the Tag.parent property.
• Checking if a tag contains any child elements in Beautiful Soup
  To check if a tag contains any child elements, fetch the list of all child elements using the Tag.find_all() method, and then test whether or not its size is zero.
• Getting all child nodes in Beautiful Soup
  To get all the child nodes of an element in Beautiful Soup, use the find_all() method.
• Getting all immediate children in Beautiful Soup
  To get all immediate children in Beautiful Soup, use the find_all(recursive=False) method.
• Getting all parent tags of a tag in Beautiful Soup
  To get all parent tags of a tag in Beautiful Soup, use the Tag.parents property, which returns a generator for iterating over the parent tags.
• Getting nth child element in Beautiful Soup
  To get the 2nd child element in Beautiful Soup, for instance, use the select_one(~) method.
• Getting number of child elements of a tag in Beautiful Soup
  To get the number of child elements of a tag, first fetch all the child elements of the tag using the find_all() method, and then just check its length using len(~).
• Getting number of direct child elements of a tag in Beautiful Soup
  To get the number of direct child elements of a tag, first fetch all the direct child elements of the tag using the find_all(recursive=False) method, and then just check its length using len(~).

Tag Cookbook

• Appending multiple strings to a tag's content in Beautiful Soup
  To append multiple strings to a tag's content in Beautiful Soup, use the Tag.extend(~) method. This method is analogous to a standard Python List's extend(~) method - it takes in an array of strings to append to the tag's content.
• Appending to a tag's content in Beautiful Soup
  To append to a tag's content in Beautiful Soup, use the Tag.append(~) method.
• Converting from tag object to string in Beautiful Soup
  To convert a Tag object to a string in Beautiful Soup, simply use str(Tag).
• Getting the position of a tag in Beautiful Soup
  BeautifulSoup gives us the following two positional information about a tag: - line number, which is accessed using the sourceline property - starting index of the tag in the line, which is using the sourcepos property
• Inserting an element at a specified position in a tag in Beautiful Soup
  To insert a string or an element at a specified position in a tag in Beautiful Soup, use the Tag.insert(~) method.
• Inserting strings or elements after a tag in Beautiful Soup
  To insert a string or an element right after a tag in Beautiful Soup, use the Tag.insert_after(~) method.
• Inserting strings or elements before a tag in Beautiful Soup
  To insert a string or an element right before a tag in Beautiful Soup, use the Tag.insert_before(~) method.
• Removing both tag and inner content in Beautiful Soup
  To remove a tag as well as its inner content in Beautiful Soup, use the decompose() method.
• Removing inner content of a tag in Beautiful Soup
  To remove the inner content of a tag in Beautiful Soup, use the Tag.clear() method.
• Replacing a tag and its inner content in Beautiful Soup
  To replace a tag and its inner content in Beautiful Soup, use the replace_with(~) method.
• Replacing inner text of a tag in Beautiful Soup
  To replace the inner text of a tag in Beautiful Soup, use the replace_with(~) method.
• Replacing the tag name of an element in Beautiful Soup
  To replace the tag name of an element in Beautiful Soup, you syntax like element.name = "new name".
• Stripping the tag of an element in Beautiful Soup
  To strip away the tag of an element in Beautiful Soup use the unwrap() method.
• Wrapping a tag with another tag in Beautiful Soup
  To wrap a tag with another tag in Beautiful Soup use the wrap(~) method.

Text Extraction Cookbook

• Extracting all text from an element in Beautiful Soup
  To extract all text from an element in Beautiful Soup, use the get_text() method.
• Extracting text that is directly under an element in Beautiful Soup
  To extract text that is directly under an element in Beautiful Soup use the find_all(text=True, recursive=False) method.