I'm having trouble doing this and can't find a good way to select them all. I need to get the live updates as well as the normal headlines. Basically every bolded headline on the site. Also, I need to get the embedded link that activates when these are clicked. I have some basic knowledge of HTML and have webscraped a few things before, but am struggling with this for some reason. Can someone walk me through it?
Upon further inspection, it seems I might want to find the children of all article classes?
You could use the requests module to download the page's HTML code, then parse it by h3 tags, which I've noticed are used for headlines.
You can then use the .find(string) method to find such HTML tag, and when you do, find the next instance of </h3> from that index of the HTML code onward.
I couldn't understand which and how many headlines you want to parse, but you can use a while loop to keep parsing for every h3 tag on the page, until you can't find a new one (the .find() method should return -1 if it doesn't locate the string).
Getting the headlines and headline links from NPR.org with Beautiful Soup