https://blog.kenhuang.io/tags/beautifulsoup/ Recent content in BeautifulSoup on Ken Huang Hugo en kenhuang512@gmail.com (Ken Huang) kenhuang512@gmail.com (Ken Huang) Wed, 26 Feb 2025 00:32:53 +0800 https://blog.kenhuang.io/blog/2021-12-05-beautifulsoup4-cheatsheet/ Sat, 25 Sep 2021 23:01:40 +0800kenhuang512@gmail.com (Ken Huang) https://blog.kenhuang.io/blog/2021-12-05-beautifulsoup4-cheatsheet/ <figure> <img src="https://www.crummy.com/software/BeautifulSoup/bs4/doc/_images/6.1.jpg" alt="Beautiful Soup" title="Click to enlarge the image"/> <figcaption> Beautiful Soup </figcaption> </figure> <p> Detailed docs: <a href="https://www.crummy.com/software/BeautifulSoup/bs4/doc/">the Beautiful Soup 4 Docs</a>.</p> <p> Assume <code class="verbatim">t</code> is an object of <code class="verbatim">Tag</code>.</p> <div id="outline-container-headline-1" class="outline-2"> <h2 id="headline-1"> Core concepts (classes) </h2> <div id="outline-text-headline-1" class="outline-text-2"> <ul> <li><code class="verbatim">Tag</code>, a Tag object corresponds to an XML or HTML tag.</li> <li><code class="verbatim">BeautifulSoup</code>, the BeautifulSoup object represents the parsed document as a whole. You can treat it like a special Tag. It needs a parser to parse the document, a built-in parser is <code class="verbatim">&#34;html.parser&#34;</code>, e.g. <code>soup = BeautifulSoup(&#34;&lt;html&gt;a web page&lt;/html&gt;&#34;, &#39;html.parser&#39;)</code></li> <li><code class="verbatim">NavigableString</code>, a string corresponds to a bit of text (as you see it in the browser) within a tag. A NavigableString is just like a Python Unicode string, except that it also supports some of the features for navigating the tree and searching the tree.</li> </ul> </div> </div> <div id="outline-container-headline-2" class="outline-2"> <h2 id="headline-2"> The <code class="verbatim">Tag</code> class </h2> <div id="outline-text-headline-2" class="outline-text-2"> <p> Object attributes:</p>