kpriv/pkgsrc
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
pkgsrc/www/py-beautifulsoup4/Makefile

20 lines
590 B
Makefile
Raw Normal View History

Update to 4.3.2: = 4.3.2 (20131002) = * Fixed a bug in which short Unicode input was improperly encoded to ASCII when checking whether or not it was the name of a file on disk. [bug=1227016] * Fixed a crash when a short input contains data not valid in filenames. [bug=1232604] * Fixed a bug that caused Unicode data put into UnicodeDammit to return None instead of the original data. [bug=1214983] * Combined two tests to stop a spurious test failure when tests are run by nosetests. [bug=1212445] = 4.3.1 (20130815) = * Fixed yet another problem with the html5lib tree builder, caused by html5lib's tendency to rearrange the tree during parsing. [bug=1189267] * Fixed a bug that caused the optimized version of find_all() to return nothing. [bug=1212655] = 4.3.0 (20130812) = * Instead of converting incoming data to Unicode and feeding it to the lxml tree builder in chunks, Beautiful Soup now makes successive guesses at the encoding of the incoming data, and tells lxml to parse the data as that encoding. Giving lxml more control over the parsing process improves performance and avoids a number of bugs and issues with the lxml parser which had previously required elaborate workarounds: - An issue in which lxml refuses to parse Unicode strings on some systems. [bug=1180527] - A returning bug that truncated documents longer than a (very small) size. [bug=963880] - A returning bug in which extra spaces were added to a document if the document defined a charset other than UTF-8. [bug=972466] This required a major overhaul of the tree builder architecture. If you wrote your own tree builder and didn't tell me, you'll need to modify your prepare_markup() method. * The UnicodeDammit code that makes guesses at encodings has been split into its own class, EncodingDetector. A lot of apparently redundant code has been removed from Unicode, Dammit, and some undocumented features have also been removed. * Beautiful Soup will issue a warning if instead of markup you pass it a URL or the name of a file on disk (a common beginner's mistake). * A number of optimizations improve the performance of the lxml tree builder by about 33%, the html.parser tree builder by about 20%, and the html5lib tree builder by about 15%. * All find_all calls should now return a ResultSet object. Patch by Aaron DeVore. [bug=1194034] = 4.2.1 (20130531) = * The default XML formatter will now replace ampersands even if they appear to be part of entities. That is, "&lt;" will become "&amp;lt;". The old code was left over from Beautiful Soup 3, which didn't always turn entities into Unicode characters. If you really want the old behavior (maybe because you add new strings to the tree, those strings include entities, and you want the formatter to leave them alone on output), it can be found in EntitySubstitution.substitute_xml_containing_entities(). [bug=1182183] * Gave new_string() the ability to create subclasses of NavigableString. [bug=1181986] * Fixed another bug by which the html5lib tree builder could create a disconnected tree. [bug=1182089] * The .previous_element of a BeautifulSoup object is now always None, not the last element to be parsed. [bug=1182089] * Fixed test failures when lxml is not installed. [bug=1181589] * html5lib now supports Python 3. Fixed some Python 2-specific code in the html5lib test suite. [bug=1181624] * The html.parser treebuilder can now handle numeric attributes in text when the hexidecimal name of the attribute starts with a capital X. Patch by Tim Shirley. [bug=1186242] = 4.2.0 (20130514) = * The Tag.select() method now supports a much wider variety of CSS selectors. - Added support for the adjacent sibling combinator (+) and the general sibling combinator (~). Tests by "liquider". [bug=1082144] - The combinators (>, +, and ~) can now combine with any supported selector, not just one that selects based on tag name. - Added limited support for the "nth-of-type" pseudo-class. Code by Sven Slootweg. [bug=1109952] * The BeautifulSoup class is now aliased to "_s" and "_soup", making it quicker to type the import statement in an interactive session: from bs4 import _s or from bs4 import _soup The alias may change in the future, so don't use this in code you're going to run more than once. * Added the 'diagnose' submodule, which includes several useful functions for reporting problems and doing tech support. - diagnose(data) tries the given markup on every installed parser, reporting exceptions and displaying successes. If a parser is not installed, diagnose() mentions this fact. - lxml_trace(data, html=True) runs the given markup through lxml's XML parser or HTML parser, and prints out the parser events as they happen. This helps you quickly determine whether a given problem occurs in lxml code or Beautiful Soup code. - htmlparser_trace(data) is the same thing, but for Python's built-in HTMLParser class. * In an HTML document, the contents of a <script> or <style> tag will no longer undergo entity substitution by default. XML documents work the same way they did before. [bug=1085953] * Methods like get_text() and properties like .strings now only give you strings that are visible in the document--no comments or processing commands. [bug=1050164] * The prettify() method now leaves the contents of <pre> tags alone. [bug=1095654] * Fix a bug in the html5lib treebuilder which sometimes created disconnected trees. [bug=1039527] * Fix a bug in the lxml treebuilder which crashed when a tag included an attribute from the predefined "xml:" namespace. [bug=1065617] * Fix a bug by which keyword arguments to find_parent() were not being passed on. [bug=1126734] * Stop a crash when unwisely messing with a tag that's been decomposed. [bug=1097699] * Now that lxml's segfault on invalid doctype has been fixed, fixed a corresponding problem on the Beautiful Soup end that was previously invisible. [bug=984936] * Fixed an exception when an overspecified CSS selector didn't match anything. Code by Stefaan Lippens. [bug=1168167] = 4.1.3 (20120820) = * Skipped a test under Python 2.6 and Python 3.1 to avoid a spurious test failure caused by the lousy HTMLParser in those versions. [bug=1038503] * Raise a more specific error (FeatureNotFound) when a requested parser or parser feature is not installed. Raise NotImplementedError instead of ValueError when the user calls insert_before() or insert_after() on the BeautifulSoup object itself. Patch by Aaron Devore. [bug=1038301] = 4.1.2 (20120817) = * As per PEP-8, allow searching by CSS class using the 'class_' keyword argument. [bug=1037624] * Display namespace prefixes for namespaced attribute names, instead of the fully-qualified names given by the lxml parser. [bug=1037597] * Fixed a crash on encoding when an attribute name contained non-ASCII characters. * When sniffing encodings, if the cchardet library is installed, Beautiful Soup uses it instead of chardet. cchardet is much faster. [bug=1020748] * Use logging.warning() instead of warning.warn() to notify the user that characters were replaced with REPLACEMENT CHARACTER. [bug=1013862] = 4.1.1 (20120703) = * Fixed an html5lib tree builder crash which happened when html5lib moved a tag with a multivalued attribute from one part of the tree to another. [bug=1019603] * Correctly display closing tags with an XML namespace declared. Patch by Andreas Kostyrka. [bug=1019635] * Fixed a typo that made parsing significantly slower than it should have been, and also waited too long to close tags with XML namespaces. [bug=1020268] * get_text() now returns an empty Unicode string if there is no text, rather than an empty bytestring. [bug=1020387] = 4.1.0 (20120529) = * Added experimental support for fixing Windows-1252 characters embedded in UTF-8 documents. (UnicodeDammit.detwingle()) * Fixed the handling of &quot; with the built-in parser. [bug=993871] * Comments, processing instructions, document type declarations, and markup declarations are now treated as preformatted strings, the way CData blocks are. [bug=1001025] * Fixed a bug with the lxml treebuilder that prevented the user from adding attributes to a tag that didn't originally have attributes. [bug=1002378] Thanks to Oliver Beattie for the patch. * Fixed some edge-case bugs having to do with inserting an element into a tag it's already inside, and replacing one of a tag's children with another. [bug=997529] * Added the ability to search for attribute values specified in UTF-8. [bug=1003974] This caused a major refactoring of the search code. All the tests pass, but it's possible that some searches will behave differently.
2014-01-19 20:56:32 +01:00
# $NetBSD: Makefile,v 1.6 2014/01/19 19:56:32 wiz Exp $
Initial import of py-beautifulsoup4, a rewrite of py-beautifulsoup. Changes compared to version 3 (in py-beautifulsoup): = 4.1.0 (20120529) = * Added experimental support for fixing Windows-1252 characters embedded in UTF-8 documents. (UnicodeDammit.detwingle()) * Fixed the handling of &quot; with the built-in parser. [bug=993871] * Comments, processing instructions, document type declarations, and markup declarations are now treated as preformatted strings, the way CData blocks are. [bug=1001025] * Fixed a bug with the lxml treebuilder that prevented the user from adding attributes to a tag that didn't originally have attributes. [bug=1002378] Thanks to Oliver Beattie for the patch. * Fixed some edge-case bugs having to do with inserting an element into a tag it's already inside, and replacing one of a tag's children with another. [bug=997529] * Added the ability to search for attribute values specified in UTF-8. [bug=1003974] This caused a major refactoring of the search code. All the tests pass, but it's possible that some searches will behave differently. = 4.0.5 (20120427) = * Added a new method, wrap(), which wraps an element in a tag. * Renamed replace_with_children() to unwrap(), which is easier to understand and also the jQuery name of the function. * Made encoding substitution in <meta> tags completely transparent (no more %SOUP-ENCODING%). * Fixed a bug in decoding data that contained a byte-order mark, such as data encoded in UTF-16LE. [bug=988980] * Fixed a bug that made the HTMLParser treebuilder generate XML definitions ending with two question marks instead of one. [bug=984258] * Upon document generation, CData objects are no longer run through the formatter. [bug=988905] * The test suite now passes when lxml is not installed, whether or not html5lib is installed. [bug=987004] * Print a warning on HTMLParseErrors to let people know they should install a better parser library. = 4.0.4 (20120416) = * Fixed a bug that sometimes created disconnected trees. * Fixed a bug with the string setter that moved a string around the tree instead of copying it. [bug=983050] * Attribute values are now run through the provided output formatter. Previously they were always run through the 'minimal' formatter. In the future I may make it possible to specify different formatters for attribute values and strings, but for now, consistent behavior is better than inconsistent behavior. [bug=980237] * Added the missing renderContents method from Beautiful Soup 3. Also added an encode_contents() method to go along with decode_contents(). * Give a more useful error when the user tries to run the Python 2 version of BS under Python 3. * UnicodeDammit can now convert Microsoft smart quotes to ASCII with UnicodeDammit(markup, smart_quotes_to="ascii"). = 4.0.3 (20120403) = * Fixed a typo that caused some versions of Python 3 to convert the Beautiful Soup codebase incorrectly. * Got rid of the 4.0.2 workaround for HTML documents--it was unnecessary and the workaround was triggering a (possibly different, but related) bug in lxml. [bug=972466] = 4.0.2 (20120326) = * Worked around a possible bug in lxml that prevents non-tiny XML documents from being parsed. [bug=963880, bug=963936] * Fixed a bug where specifying `text` while also searching for a tag only worked if `text` wanted an exact string match. [bug=955942] = 4.0.1 (20120314) = * This is the first official release of Beautiful Soup 4. There is no 4.0.0 release, to eliminate any possibility that packaging software might treat "4.0.0" as being an earlier version than "4.0.0b10". * Brought BS up to date with the latest release of soupselect, adding CSS selector support for direct descendant matches and multiple CSS class matches. = 4.0.0b10 (20120302) = * Added support for simple CSS selectors, taken from the soupselect project. * Fixed a crash when using html5lib. [bug=943246] * In HTML5-style <meta charset="foo"> tags, the value of the "charset" attribute is now replaced with the appropriate encoding on output. [bug=942714] * Fixed a bug that caused calling a tag to sometimes call find_all() with the wrong arguments. [bug=944426] * For backwards compatibility, brought back the BeautifulStoneSoup class as a deprecated wrapper around BeautifulSoup. = 4.0.0b9 (20120228) = * Fixed the string representation of DOCTYPEs that have both a public ID and a system ID. * Fixed the generated XML declaration. * Renamed Tag.nsprefix to Tag.prefix, for consistency with NamespacedAttribute. * Fixed a test failure that occured on Python 3.x when chardet was installed. * Made prettify() return Unicode by default, so it will look nice on Python 3 when passed into print(). = 4.0.0b8 (20120224) = * All tree builders now preserve namespace information in the documents they parse. If you use the html5lib parser or lxml's XML parser, you can access the namespace URL for a tag as tag.namespace. However, there is no special support for namespace-oriented searching or tree manipulation. When you search the tree, you need to use namespace prefixes exactly as they're used in the original document. * The string representation of a DOCTYPE always ends in a newline. * Issue a warning if the user tries to use a SoupStrainer in conjunction with the html5lib tree builder, which doesn't support them. = 4.0.0b7 (20120223) = * Upon decoding to string, any characters that can't be represented in your chosen encoding will be converted into numeric XML entity references. * Issue a warning if characters were replaced with REPLACEMENT CHARACTER during Unicode conversion. * Restored compatibility with Python 2.6. * The install process no longer installs docs or auxillary text files. * It's now possible to deepcopy a BeautifulSoup object created with Python's built-in HTML parser. * About 100 unit tests that "test" the behavior of various parsers on invalid markup have been removed. Legitimate changes to those parsers caused these tests to fail, indicating that perhaps Beautiful Soup should not test the behavior of foreign libraries. The problematic unit tests have been reformulated as informational comparisons generated by the script scripts/demonstrate_parser_differences.py. This makes Beautiful Soup compatible with html5lib version 0.95 and future versions of HTMLParser. = 4.0.0b6 (20120216) = * Multi-valued attributes like "class" always have a list of values, even if there's only one value in the list. * Added a number of multi-valued attributes defined in HTML5. * Stopped generating a space before the slash that closes an empty-element tag. This may come back if I add a special XHTML mode (http://www.w3.org/TR/xhtml1/#C_2), but right now it's pretty useless. * Passing text along with tag-specific arguments to a find* method: find("a", text="Click here") will find tags that contain the given text as their .string. Previously, the tag-specific arguments were ignored and only strings were searched. * Fixed a bug that caused the html5lib tree builder to build a partially disconnected tree. Generally cleaned up the html5lib tree builder. * If you restrict a multi-valued attribute like "class" to a string that contains spaces, Beautiful Soup will only consider it a match if the values correspond to that specific string. = 4.0.0b5 (20120209) = * Rationalized Beautiful Soup's treatment of CSS class. A tag belonging to multiple CSS classes is treated as having a list of values for the 'class' attribute. Searching for a CSS class will match *any* of the CSS classes. This actually affects all attributes that the HTML standard defines as taking multiple values (class, rel, rev, archive, accept-charset, and headers), but 'class' is by far the most common. [bug=41034] * If you pass anything other than a dictionary as the second argument to one of the find* methods, it'll assume you want to use that object to search against a tag's CSS classes. Previously this only worked if you passed in a string. * Fixed a bug that caused a crash when you passed a dictionary as an attribute value (possibly because you mistyped "attrs"). [bug=842419] * Unicode, Dammit now detects the encoding in HTML 5-style <meta> tags like <meta charset="utf-8" />. [bug=837268] * If Unicode, Dammit can't figure out a consistent encoding for a page, it will try each of its guesses again, with errors="replace" instead of errors="strict". This may mean that some data gets replaced with REPLACEMENT CHARACTER, but at least most of it will get turned into Unicode. [bug=754903] * Patched over a bug in html5lib (?) that was crashing Beautiful Soup on certain kinds of markup. [bug=838800] * Fixed a bug that wrecked the tree if you replaced an element with an empty string. [bug=728697] * Improved Unicode, Dammit's behavior when you give it Unicode to begin with. = 4.0.0b4 (20120208) = * Added BeautifulSoup.new_string() to go along with BeautifulSoup.new_tag() * BeautifulSoup.new_tag() will follow the rules of whatever tree-builder was used to create the original BeautifulSoup object. A new <p> tag will look like "<p />" if the soup object was created to parse XML, but it will look like "<p></p>" if the soup object was created to parse HTML. * We pass in strict=False to html.parser on Python 3, greatly improving html.parser's ability to handle bad HTML. * We also monkeypatch a serious bug in html.parser that made strict=False disastrous on Python 3.2.2. * Replaced the "substitute_html_entities" argument with the more general "formatter" argument. * Bare ampersands and angle brackets are always converted to XML entities unless the user prevents it. * Added PageElement.insert_before() and PageElement.insert_after(), which let you put an element into the parse tree with respect to some other element. * Raise an exception when the user tries to do something nonsensical like insert a tag into itself. = 4.0.0b3 (20120203) = Beautiful Soup 4 is a nearly-complete rewrite that removes Beautiful Soup's custom HTML parser in favor of a system that lets you write a little glue code and plug in any HTML or XML parser you want. Beautiful Soup 4.0 comes with glue code for four parsers: * Python's standard HTMLParser (html.parser in Python 3) * lxml's HTML and XML parsers * html5lib's HTML parser HTMLParser is the default, but I recommend you install lxml if you can. For complete documentation, see the Sphinx documentation in bs4/doc/source/. What follows is a summary of the changes from Beautiful Soup 3. === The module name has changed === Previously you imported the BeautifulSoup class from a module also called BeautifulSoup. To save keystrokes and make it clear which version of the API is in use, the module is now called 'bs4': >>> from bs4 import BeautifulSoup === It works with Python 3 === Beautiful Soup 3.1.0 worked with Python 3, but the parser it used was so bad that it barely worked at all. Beautiful Soup 4 works with Python 3, and since its parser is pluggable, you don't sacrifice quality. Special thanks to Thomas Kluyver and Ezio Melotti for getting Python 3 support to the finish line. Ezio Melotti is also to thank for greatly improving the HTML parser that comes with Python 3.2. === CDATA sections are normal text, if they're understood at all. === Currently, the lxml and html5lib HTML parsers ignore CDATA sections in markup: <p><![CDATA[foo]]></p> => <p></p> A future version of html5lib will turn CDATA sections into text nodes, but only within tags like <svg> and <math>: <svg><![CDATA[foo]]></svg> => <p>foo</p> The default XML parser (which uses lxml behind the scenes) turns CDATA sections into ordinary text elements: <p><![CDATA[foo]]></p> => <p>foo</p> In theory it's possible to preserve the CDATA sections when using the XML parser, but I don't see how to get it to work in practice. === Miscellaneous other stuff === If the BeautifulSoup instance has .is_xml set to True, an appropriate XML declaration will be emitted when the tree is transformed into a string: <?xml version="1.0" encoding="utf-8"> <markup> ... </markup> The ['lxml', 'xml'] tree builder sets .is_xml to True; the other tree builders set it to False. If you want to parse XHTML with an HTML parser, you can set it manually.
2012-06-03 23:29:57 +02:00
Update to 4.3.2: = 4.3.2 (20131002) = * Fixed a bug in which short Unicode input was improperly encoded to ASCII when checking whether or not it was the name of a file on disk. [bug=1227016] * Fixed a crash when a short input contains data not valid in filenames. [bug=1232604] * Fixed a bug that caused Unicode data put into UnicodeDammit to return None instead of the original data. [bug=1214983] * Combined two tests to stop a spurious test failure when tests are run by nosetests. [bug=1212445] = 4.3.1 (20130815) = * Fixed yet another problem with the html5lib tree builder, caused by html5lib's tendency to rearrange the tree during parsing. [bug=1189267] * Fixed a bug that caused the optimized version of find_all() to return nothing. [bug=1212655] = 4.3.0 (20130812) = * Instead of converting incoming data to Unicode and feeding it to the lxml tree builder in chunks, Beautiful Soup now makes successive guesses at the encoding of the incoming data, and tells lxml to parse the data as that encoding. Giving lxml more control over the parsing process improves performance and avoids a number of bugs and issues with the lxml parser which had previously required elaborate workarounds: - An issue in which lxml refuses to parse Unicode strings on some systems. [bug=1180527] - A returning bug that truncated documents longer than a (very small) size. [bug=963880] - A returning bug in which extra spaces were added to a document if the document defined a charset other than UTF-8. [bug=972466] This required a major overhaul of the tree builder architecture. If you wrote your own tree builder and didn't tell me, you'll need to modify your prepare_markup() method. * The UnicodeDammit code that makes guesses at encodings has been split into its own class, EncodingDetector. A lot of apparently redundant code has been removed from Unicode, Dammit, and some undocumented features have also been removed. * Beautiful Soup will issue a warning if instead of markup you pass it a URL or the name of a file on disk (a common beginner's mistake). * A number of optimizations improve the performance of the lxml tree builder by about 33%, the html.parser tree builder by about 20%, and the html5lib tree builder by about 15%. * All find_all calls should now return a ResultSet object. Patch by Aaron DeVore. [bug=1194034] = 4.2.1 (20130531) = * The default XML formatter will now replace ampersands even if they appear to be part of entities. That is, "&lt;" will become "&amp;lt;". The old code was left over from Beautiful Soup 3, which didn't always turn entities into Unicode characters. If you really want the old behavior (maybe because you add new strings to the tree, those strings include entities, and you want the formatter to leave them alone on output), it can be found in EntitySubstitution.substitute_xml_containing_entities(). [bug=1182183] * Gave new_string() the ability to create subclasses of NavigableString. [bug=1181986] * Fixed another bug by which the html5lib tree builder could create a disconnected tree. [bug=1182089] * The .previous_element of a BeautifulSoup object is now always None, not the last element to be parsed. [bug=1182089] * Fixed test failures when lxml is not installed. [bug=1181589] * html5lib now supports Python 3. Fixed some Python 2-specific code in the html5lib test suite. [bug=1181624] * The html.parser treebuilder can now handle numeric attributes in text when the hexidecimal name of the attribute starts with a capital X. Patch by Tim Shirley. [bug=1186242] = 4.2.0 (20130514) = * The Tag.select() method now supports a much wider variety of CSS selectors. - Added support for the adjacent sibling combinator (+) and the general sibling combinator (~). Tests by "liquider". [bug=1082144] - The combinators (>, +, and ~) can now combine with any supported selector, not just one that selects based on tag name. - Added limited support for the "nth-of-type" pseudo-class. Code by Sven Slootweg. [bug=1109952] * The BeautifulSoup class is now aliased to "_s" and "_soup", making it quicker to type the import statement in an interactive session: from bs4 import _s or from bs4 import _soup The alias may change in the future, so don't use this in code you're going to run more than once. * Added the 'diagnose' submodule, which includes several useful functions for reporting problems and doing tech support. - diagnose(data) tries the given markup on every installed parser, reporting exceptions and displaying successes. If a parser is not installed, diagnose() mentions this fact. - lxml_trace(data, html=True) runs the given markup through lxml's XML parser or HTML parser, and prints out the parser events as they happen. This helps you quickly determine whether a given problem occurs in lxml code or Beautiful Soup code. - htmlparser_trace(data) is the same thing, but for Python's built-in HTMLParser class. * In an HTML document, the contents of a <script> or <style> tag will no longer undergo entity substitution by default. XML documents work the same way they did before. [bug=1085953] * Methods like get_text() and properties like .strings now only give you strings that are visible in the document--no comments or processing commands. [bug=1050164] * The prettify() method now leaves the contents of <pre> tags alone. [bug=1095654] * Fix a bug in the html5lib treebuilder which sometimes created disconnected trees. [bug=1039527] * Fix a bug in the lxml treebuilder which crashed when a tag included an attribute from the predefined "xml:" namespace. [bug=1065617] * Fix a bug by which keyword arguments to find_parent() were not being passed on. [bug=1126734] * Stop a crash when unwisely messing with a tag that's been decomposed. [bug=1097699] * Now that lxml's segfault on invalid doctype has been fixed, fixed a corresponding problem on the Beautiful Soup end that was previously invisible. [bug=984936] * Fixed an exception when an overspecified CSS selector didn't match anything. Code by Stefaan Lippens. [bug=1168167] = 4.1.3 (20120820) = * Skipped a test under Python 2.6 and Python 3.1 to avoid a spurious test failure caused by the lousy HTMLParser in those versions. [bug=1038503] * Raise a more specific error (FeatureNotFound) when a requested parser or parser feature is not installed. Raise NotImplementedError instead of ValueError when the user calls insert_before() or insert_after() on the BeautifulSoup object itself. Patch by Aaron Devore. [bug=1038301] = 4.1.2 (20120817) = * As per PEP-8, allow searching by CSS class using the 'class_' keyword argument. [bug=1037624] * Display namespace prefixes for namespaced attribute names, instead of the fully-qualified names given by the lxml parser. [bug=1037597] * Fixed a crash on encoding when an attribute name contained non-ASCII characters. * When sniffing encodings, if the cchardet library is installed, Beautiful Soup uses it instead of chardet. cchardet is much faster. [bug=1020748] * Use logging.warning() instead of warning.warn() to notify the user that characters were replaced with REPLACEMENT CHARACTER. [bug=1013862] = 4.1.1 (20120703) = * Fixed an html5lib tree builder crash which happened when html5lib moved a tag with a multivalued attribute from one part of the tree to another. [bug=1019603] * Correctly display closing tags with an XML namespace declared. Patch by Andreas Kostyrka. [bug=1019635] * Fixed a typo that made parsing significantly slower than it should have been, and also waited too long to close tags with XML namespaces. [bug=1020268] * get_text() now returns an empty Unicode string if there is no text, rather than an empty bytestring. [bug=1020387] = 4.1.0 (20120529) = * Added experimental support for fixing Windows-1252 characters embedded in UTF-8 documents. (UnicodeDammit.detwingle()) * Fixed the handling of &quot; with the built-in parser. [bug=993871] * Comments, processing instructions, document type declarations, and markup declarations are now treated as preformatted strings, the way CData blocks are. [bug=1001025] * Fixed a bug with the lxml treebuilder that prevented the user from adding attributes to a tag that didn't originally have attributes. [bug=1002378] Thanks to Oliver Beattie for the patch. * Fixed some edge-case bugs having to do with inserting an element into a tag it's already inside, and replacing one of a tag's children with another. [bug=997529] * Added the ability to search for attribute values specified in UTF-8. [bug=1003974] This caused a major refactoring of the search code. All the tests pass, but it's possible that some searches will behave differently.
2014-01-19 20:56:32 +01:00
DISTNAME= beautifulsoup4-4.3.2
Initial import of py-beautifulsoup4, a rewrite of py-beautifulsoup. Changes compared to version 3 (in py-beautifulsoup): = 4.1.0 (20120529) = * Added experimental support for fixing Windows-1252 characters embedded in UTF-8 documents. (UnicodeDammit.detwingle()) * Fixed the handling of &quot; with the built-in parser. [bug=993871] * Comments, processing instructions, document type declarations, and markup declarations are now treated as preformatted strings, the way CData blocks are. [bug=1001025] * Fixed a bug with the lxml treebuilder that prevented the user from adding attributes to a tag that didn't originally have attributes. [bug=1002378] Thanks to Oliver Beattie for the patch. * Fixed some edge-case bugs having to do with inserting an element into a tag it's already inside, and replacing one of a tag's children with another. [bug=997529] * Added the ability to search for attribute values specified in UTF-8. [bug=1003974] This caused a major refactoring of the search code. All the tests pass, but it's possible that some searches will behave differently. = 4.0.5 (20120427) = * Added a new method, wrap(), which wraps an element in a tag. * Renamed replace_with_children() to unwrap(), which is easier to understand and also the jQuery name of the function. * Made encoding substitution in <meta> tags completely transparent (no more %SOUP-ENCODING%). * Fixed a bug in decoding data that contained a byte-order mark, such as data encoded in UTF-16LE. [bug=988980] * Fixed a bug that made the HTMLParser treebuilder generate XML definitions ending with two question marks instead of one. [bug=984258] * Upon document generation, CData objects are no longer run through the formatter. [bug=988905] * The test suite now passes when lxml is not installed, whether or not html5lib is installed. [bug=987004] * Print a warning on HTMLParseErrors to let people know they should install a better parser library. = 4.0.4 (20120416) = * Fixed a bug that sometimes created disconnected trees. * Fixed a bug with the string setter that moved a string around the tree instead of copying it. [bug=983050] * Attribute values are now run through the provided output formatter. Previously they were always run through the 'minimal' formatter. In the future I may make it possible to specify different formatters for attribute values and strings, but for now, consistent behavior is better than inconsistent behavior. [bug=980237] * Added the missing renderContents method from Beautiful Soup 3. Also added an encode_contents() method to go along with decode_contents(). * Give a more useful error when the user tries to run the Python 2 version of BS under Python 3. * UnicodeDammit can now convert Microsoft smart quotes to ASCII with UnicodeDammit(markup, smart_quotes_to="ascii"). = 4.0.3 (20120403) = * Fixed a typo that caused some versions of Python 3 to convert the Beautiful Soup codebase incorrectly. * Got rid of the 4.0.2 workaround for HTML documents--it was unnecessary and the workaround was triggering a (possibly different, but related) bug in lxml. [bug=972466] = 4.0.2 (20120326) = * Worked around a possible bug in lxml that prevents non-tiny XML documents from being parsed. [bug=963880, bug=963936] * Fixed a bug where specifying `text` while also searching for a tag only worked if `text` wanted an exact string match. [bug=955942] = 4.0.1 (20120314) = * This is the first official release of Beautiful Soup 4. There is no 4.0.0 release, to eliminate any possibility that packaging software might treat "4.0.0" as being an earlier version than "4.0.0b10". * Brought BS up to date with the latest release of soupselect, adding CSS selector support for direct descendant matches and multiple CSS class matches. = 4.0.0b10 (20120302) = * Added support for simple CSS selectors, taken from the soupselect project. * Fixed a crash when using html5lib. [bug=943246] * In HTML5-style <meta charset="foo"> tags, the value of the "charset" attribute is now replaced with the appropriate encoding on output. [bug=942714] * Fixed a bug that caused calling a tag to sometimes call find_all() with the wrong arguments. [bug=944426] * For backwards compatibility, brought back the BeautifulStoneSoup class as a deprecated wrapper around BeautifulSoup. = 4.0.0b9 (20120228) = * Fixed the string representation of DOCTYPEs that have both a public ID and a system ID. * Fixed the generated XML declaration. * Renamed Tag.nsprefix to Tag.prefix, for consistency with NamespacedAttribute. * Fixed a test failure that occured on Python 3.x when chardet was installed. * Made prettify() return Unicode by default, so it will look nice on Python 3 when passed into print(). = 4.0.0b8 (20120224) = * All tree builders now preserve namespace information in the documents they parse. If you use the html5lib parser or lxml's XML parser, you can access the namespace URL for a tag as tag.namespace. However, there is no special support for namespace-oriented searching or tree manipulation. When you search the tree, you need to use namespace prefixes exactly as they're used in the original document. * The string representation of a DOCTYPE always ends in a newline. * Issue a warning if the user tries to use a SoupStrainer in conjunction with the html5lib tree builder, which doesn't support them. = 4.0.0b7 (20120223) = * Upon decoding to string, any characters that can't be represented in your chosen encoding will be converted into numeric XML entity references. * Issue a warning if characters were replaced with REPLACEMENT CHARACTER during Unicode conversion. * Restored compatibility with Python 2.6. * The install process no longer installs docs or auxillary text files. * It's now possible to deepcopy a BeautifulSoup object created with Python's built-in HTML parser. * About 100 unit tests that "test" the behavior of various parsers on invalid markup have been removed. Legitimate changes to those parsers caused these tests to fail, indicating that perhaps Beautiful Soup should not test the behavior of foreign libraries. The problematic unit tests have been reformulated as informational comparisons generated by the script scripts/demonstrate_parser_differences.py. This makes Beautiful Soup compatible with html5lib version 0.95 and future versions of HTMLParser. = 4.0.0b6 (20120216) = * Multi-valued attributes like "class" always have a list of values, even if there's only one value in the list. * Added a number of multi-valued attributes defined in HTML5. * Stopped generating a space before the slash that closes an empty-element tag. This may come back if I add a special XHTML mode (http://www.w3.org/TR/xhtml1/#C_2), but right now it's pretty useless. * Passing text along with tag-specific arguments to a find* method: find("a", text="Click here") will find tags that contain the given text as their .string. Previously, the tag-specific arguments were ignored and only strings were searched. * Fixed a bug that caused the html5lib tree builder to build a partially disconnected tree. Generally cleaned up the html5lib tree builder. * If you restrict a multi-valued attribute like "class" to a string that contains spaces, Beautiful Soup will only consider it a match if the values correspond to that specific string. = 4.0.0b5 (20120209) = * Rationalized Beautiful Soup's treatment of CSS class. A tag belonging to multiple CSS classes is treated as having a list of values for the 'class' attribute. Searching for a CSS class will match *any* of the CSS classes. This actually affects all attributes that the HTML standard defines as taking multiple values (class, rel, rev, archive, accept-charset, and headers), but 'class' is by far the most common. [bug=41034] * If you pass anything other than a dictionary as the second argument to one of the find* methods, it'll assume you want to use that object to search against a tag's CSS classes. Previously this only worked if you passed in a string. * Fixed a bug that caused a crash when you passed a dictionary as an attribute value (possibly because you mistyped "attrs"). [bug=842419] * Unicode, Dammit now detects the encoding in HTML 5-style <meta> tags like <meta charset="utf-8" />. [bug=837268] * If Unicode, Dammit can't figure out a consistent encoding for a page, it will try each of its guesses again, with errors="replace" instead of errors="strict". This may mean that some data gets replaced with REPLACEMENT CHARACTER, but at least most of it will get turned into Unicode. [bug=754903] * Patched over a bug in html5lib (?) that was crashing Beautiful Soup on certain kinds of markup. [bug=838800] * Fixed a bug that wrecked the tree if you replaced an element with an empty string. [bug=728697] * Improved Unicode, Dammit's behavior when you give it Unicode to begin with. = 4.0.0b4 (20120208) = * Added BeautifulSoup.new_string() to go along with BeautifulSoup.new_tag() * BeautifulSoup.new_tag() will follow the rules of whatever tree-builder was used to create the original BeautifulSoup object. A new <p> tag will look like "<p />" if the soup object was created to parse XML, but it will look like "<p></p>" if the soup object was created to parse HTML. * We pass in strict=False to html.parser on Python 3, greatly improving html.parser's ability to handle bad HTML. * We also monkeypatch a serious bug in html.parser that made strict=False disastrous on Python 3.2.2. * Replaced the "substitute_html_entities" argument with the more general "formatter" argument. * Bare ampersands and angle brackets are always converted to XML entities unless the user prevents it. * Added PageElement.insert_before() and PageElement.insert_after(), which let you put an element into the parse tree with respect to some other element. * Raise an exception when the user tries to do something nonsensical like insert a tag into itself. = 4.0.0b3 (20120203) = Beautiful Soup 4 is a nearly-complete rewrite that removes Beautiful Soup's custom HTML parser in favor of a system that lets you write a little glue code and plug in any HTML or XML parser you want. Beautiful Soup 4.0 comes with glue code for four parsers: * Python's standard HTMLParser (html.parser in Python 3) * lxml's HTML and XML parsers * html5lib's HTML parser HTMLParser is the default, but I recommend you install lxml if you can. For complete documentation, see the Sphinx documentation in bs4/doc/source/. What follows is a summary of the changes from Beautiful Soup 3. === The module name has changed === Previously you imported the BeautifulSoup class from a module also called BeautifulSoup. To save keystrokes and make it clear which version of the API is in use, the module is now called 'bs4': >>> from bs4 import BeautifulSoup === It works with Python 3 === Beautiful Soup 3.1.0 worked with Python 3, but the parser it used was so bad that it barely worked at all. Beautiful Soup 4 works with Python 3, and since its parser is pluggable, you don't sacrifice quality. Special thanks to Thomas Kluyver and Ezio Melotti for getting Python 3 support to the finish line. Ezio Melotti is also to thank for greatly improving the HTML parser that comes with Python 3.2. === CDATA sections are normal text, if they're understood at all. === Currently, the lxml and html5lib HTML parsers ignore CDATA sections in markup: <p><![CDATA[foo]]></p> => <p></p> A future version of html5lib will turn CDATA sections into text nodes, but only within tags like <svg> and <math>: <svg><![CDATA[foo]]></svg> => <p>foo</p> The default XML parser (which uses lxml behind the scenes) turns CDATA sections into ordinary text elements: <p><![CDATA[foo]]></p> => <p>foo</p> In theory it's possible to preserve the CDATA sections when using the XML parser, but I don't see how to get it to work in practice. === Miscellaneous other stuff === If the BeautifulSoup instance has .is_xml set to True, an appropriate XML declaration will be emitted when the tree is transformed into a string: <?xml version="1.0" encoding="utf-8"> <markup> ... </markup> The ['lxml', 'xml'] tree builder sets .is_xml to True; the other tree builders set it to False. If you want to parse XHTML with an HTML parser, you can set it manually.
2012-06-03 23:29:57 +02:00
PKGNAME= ${PYPKGPREFIX}-${DISTNAME}
CATEGORIES= www python
Update to 4.3.2: = 4.3.2 (20131002) = * Fixed a bug in which short Unicode input was improperly encoded to ASCII when checking whether or not it was the name of a file on disk. [bug=1227016] * Fixed a crash when a short input contains data not valid in filenames. [bug=1232604] * Fixed a bug that caused Unicode data put into UnicodeDammit to return None instead of the original data. [bug=1214983] * Combined two tests to stop a spurious test failure when tests are run by nosetests. [bug=1212445] = 4.3.1 (20130815) = * Fixed yet another problem with the html5lib tree builder, caused by html5lib's tendency to rearrange the tree during parsing. [bug=1189267] * Fixed a bug that caused the optimized version of find_all() to return nothing. [bug=1212655] = 4.3.0 (20130812) = * Instead of converting incoming data to Unicode and feeding it to the lxml tree builder in chunks, Beautiful Soup now makes successive guesses at the encoding of the incoming data, and tells lxml to parse the data as that encoding. Giving lxml more control over the parsing process improves performance and avoids a number of bugs and issues with the lxml parser which had previously required elaborate workarounds: - An issue in which lxml refuses to parse Unicode strings on some systems. [bug=1180527] - A returning bug that truncated documents longer than a (very small) size. [bug=963880] - A returning bug in which extra spaces were added to a document if the document defined a charset other than UTF-8. [bug=972466] This required a major overhaul of the tree builder architecture. If you wrote your own tree builder and didn't tell me, you'll need to modify your prepare_markup() method. * The UnicodeDammit code that makes guesses at encodings has been split into its own class, EncodingDetector. A lot of apparently redundant code has been removed from Unicode, Dammit, and some undocumented features have also been removed. * Beautiful Soup will issue a warning if instead of markup you pass it a URL or the name of a file on disk (a common beginner's mistake). * A number of optimizations improve the performance of the lxml tree builder by about 33%, the html.parser tree builder by about 20%, and the html5lib tree builder by about 15%. * All find_all calls should now return a ResultSet object. Patch by Aaron DeVore. [bug=1194034] = 4.2.1 (20130531) = * The default XML formatter will now replace ampersands even if they appear to be part of entities. That is, "&lt;" will become "&amp;lt;". The old code was left over from Beautiful Soup 3, which didn't always turn entities into Unicode characters. If you really want the old behavior (maybe because you add new strings to the tree, those strings include entities, and you want the formatter to leave them alone on output), it can be found in EntitySubstitution.substitute_xml_containing_entities(). [bug=1182183] * Gave new_string() the ability to create subclasses of NavigableString. [bug=1181986] * Fixed another bug by which the html5lib tree builder could create a disconnected tree. [bug=1182089] * The .previous_element of a BeautifulSoup object is now always None, not the last element to be parsed. [bug=1182089] * Fixed test failures when lxml is not installed. [bug=1181589] * html5lib now supports Python 3. Fixed some Python 2-specific code in the html5lib test suite. [bug=1181624] * The html.parser treebuilder can now handle numeric attributes in text when the hexidecimal name of the attribute starts with a capital X. Patch by Tim Shirley. [bug=1186242] = 4.2.0 (20130514) = * The Tag.select() method now supports a much wider variety of CSS selectors. - Added support for the adjacent sibling combinator (+) and the general sibling combinator (~). Tests by "liquider". [bug=1082144] - The combinators (>, +, and ~) can now combine with any supported selector, not just one that selects based on tag name. - Added limited support for the "nth-of-type" pseudo-class. Code by Sven Slootweg. [bug=1109952] * The BeautifulSoup class is now aliased to "_s" and "_soup", making it quicker to type the import statement in an interactive session: from bs4 import _s or from bs4 import _soup The alias may change in the future, so don't use this in code you're going to run more than once. * Added the 'diagnose' submodule, which includes several useful functions for reporting problems and doing tech support. - diagnose(data) tries the given markup on every installed parser, reporting exceptions and displaying successes. If a parser is not installed, diagnose() mentions this fact. - lxml_trace(data, html=True) runs the given markup through lxml's XML parser or HTML parser, and prints out the parser events as they happen. This helps you quickly determine whether a given problem occurs in lxml code or Beautiful Soup code. - htmlparser_trace(data) is the same thing, but for Python's built-in HTMLParser class. * In an HTML document, the contents of a <script> or <style> tag will no longer undergo entity substitution by default. XML documents work the same way they did before. [bug=1085953] * Methods like get_text() and properties like .strings now only give you strings that are visible in the document--no comments or processing commands. [bug=1050164] * The prettify() method now leaves the contents of <pre> tags alone. [bug=1095654] * Fix a bug in the html5lib treebuilder which sometimes created disconnected trees. [bug=1039527] * Fix a bug in the lxml treebuilder which crashed when a tag included an attribute from the predefined "xml:" namespace. [bug=1065617] * Fix a bug by which keyword arguments to find_parent() were not being passed on. [bug=1126734] * Stop a crash when unwisely messing with a tag that's been decomposed. [bug=1097699] * Now that lxml's segfault on invalid doctype has been fixed, fixed a corresponding problem on the Beautiful Soup end that was previously invisible. [bug=984936] * Fixed an exception when an overspecified CSS selector didn't match anything. Code by Stefaan Lippens. [bug=1168167] = 4.1.3 (20120820) = * Skipped a test under Python 2.6 and Python 3.1 to avoid a spurious test failure caused by the lousy HTMLParser in those versions. [bug=1038503] * Raise a more specific error (FeatureNotFound) when a requested parser or parser feature is not installed. Raise NotImplementedError instead of ValueError when the user calls insert_before() or insert_after() on the BeautifulSoup object itself. Patch by Aaron Devore. [bug=1038301] = 4.1.2 (20120817) = * As per PEP-8, allow searching by CSS class using the 'class_' keyword argument. [bug=1037624] * Display namespace prefixes for namespaced attribute names, instead of the fully-qualified names given by the lxml parser. [bug=1037597] * Fixed a crash on encoding when an attribute name contained non-ASCII characters. * When sniffing encodings, if the cchardet library is installed, Beautiful Soup uses it instead of chardet. cchardet is much faster. [bug=1020748] * Use logging.warning() instead of warning.warn() to notify the user that characters were replaced with REPLACEMENT CHARACTER. [bug=1013862] = 4.1.1 (20120703) = * Fixed an html5lib tree builder crash which happened when html5lib moved a tag with a multivalued attribute from one part of the tree to another. [bug=1019603] * Correctly display closing tags with an XML namespace declared. Patch by Andreas Kostyrka. [bug=1019635] * Fixed a typo that made parsing significantly slower than it should have been, and also waited too long to close tags with XML namespaces. [bug=1020268] * get_text() now returns an empty Unicode string if there is no text, rather than an empty bytestring. [bug=1020387] = 4.1.0 (20120529) = * Added experimental support for fixing Windows-1252 characters embedded in UTF-8 documents. (UnicodeDammit.detwingle()) * Fixed the handling of &quot; with the built-in parser. [bug=993871] * Comments, processing instructions, document type declarations, and markup declarations are now treated as preformatted strings, the way CData blocks are. [bug=1001025] * Fixed a bug with the lxml treebuilder that prevented the user from adding attributes to a tag that didn't originally have attributes. [bug=1002378] Thanks to Oliver Beattie for the patch. * Fixed some edge-case bugs having to do with inserting an element into a tag it's already inside, and replacing one of a tag's children with another. [bug=997529] * Added the ability to search for attribute values specified in UTF-8. [bug=1003974] This caused a major refactoring of the search code. All the tests pass, but it's possible that some searches will behave differently.
2014-01-19 20:56:32 +01:00
MASTER_SITES= http://www.crummy.com/software/BeautifulSoup/bs4/download/4.3/
Initial import of py-beautifulsoup4, a rewrite of py-beautifulsoup. Changes compared to version 3 (in py-beautifulsoup): = 4.1.0 (20120529) = * Added experimental support for fixing Windows-1252 characters embedded in UTF-8 documents. (UnicodeDammit.detwingle()) * Fixed the handling of &quot; with the built-in parser. [bug=993871] * Comments, processing instructions, document type declarations, and markup declarations are now treated as preformatted strings, the way CData blocks are. [bug=1001025] * Fixed a bug with the lxml treebuilder that prevented the user from adding attributes to a tag that didn't originally have attributes. [bug=1002378] Thanks to Oliver Beattie for the patch. * Fixed some edge-case bugs having to do with inserting an element into a tag it's already inside, and replacing one of a tag's children with another. [bug=997529] * Added the ability to search for attribute values specified in UTF-8. [bug=1003974] This caused a major refactoring of the search code. All the tests pass, but it's possible that some searches will behave differently. = 4.0.5 (20120427) = * Added a new method, wrap(), which wraps an element in a tag. * Renamed replace_with_children() to unwrap(), which is easier to understand and also the jQuery name of the function. * Made encoding substitution in <meta> tags completely transparent (no more %SOUP-ENCODING%). * Fixed a bug in decoding data that contained a byte-order mark, such as data encoded in UTF-16LE. [bug=988980] * Fixed a bug that made the HTMLParser treebuilder generate XML definitions ending with two question marks instead of one. [bug=984258] * Upon document generation, CData objects are no longer run through the formatter. [bug=988905] * The test suite now passes when lxml is not installed, whether or not html5lib is installed. [bug=987004] * Print a warning on HTMLParseErrors to let people know they should install a better parser library. = 4.0.4 (20120416) = * Fixed a bug that sometimes created disconnected trees. * Fixed a bug with the string setter that moved a string around the tree instead of copying it. [bug=983050] * Attribute values are now run through the provided output formatter. Previously they were always run through the 'minimal' formatter. In the future I may make it possible to specify different formatters for attribute values and strings, but for now, consistent behavior is better than inconsistent behavior. [bug=980237] * Added the missing renderContents method from Beautiful Soup 3. Also added an encode_contents() method to go along with decode_contents(). * Give a more useful error when the user tries to run the Python 2 version of BS under Python 3. * UnicodeDammit can now convert Microsoft smart quotes to ASCII with UnicodeDammit(markup, smart_quotes_to="ascii"). = 4.0.3 (20120403) = * Fixed a typo that caused some versions of Python 3 to convert the Beautiful Soup codebase incorrectly. * Got rid of the 4.0.2 workaround for HTML documents--it was unnecessary and the workaround was triggering a (possibly different, but related) bug in lxml. [bug=972466] = 4.0.2 (20120326) = * Worked around a possible bug in lxml that prevents non-tiny XML documents from being parsed. [bug=963880, bug=963936] * Fixed a bug where specifying `text` while also searching for a tag only worked if `text` wanted an exact string match. [bug=955942] = 4.0.1 (20120314) = * This is the first official release of Beautiful Soup 4. There is no 4.0.0 release, to eliminate any possibility that packaging software might treat "4.0.0" as being an earlier version than "4.0.0b10". * Brought BS up to date with the latest release of soupselect, adding CSS selector support for direct descendant matches and multiple CSS class matches. = 4.0.0b10 (20120302) = * Added support for simple CSS selectors, taken from the soupselect project. * Fixed a crash when using html5lib. [bug=943246] * In HTML5-style <meta charset="foo"> tags, the value of the "charset" attribute is now replaced with the appropriate encoding on output. [bug=942714] * Fixed a bug that caused calling a tag to sometimes call find_all() with the wrong arguments. [bug=944426] * For backwards compatibility, brought back the BeautifulStoneSoup class as a deprecated wrapper around BeautifulSoup. = 4.0.0b9 (20120228) = * Fixed the string representation of DOCTYPEs that have both a public ID and a system ID. * Fixed the generated XML declaration. * Renamed Tag.nsprefix to Tag.prefix, for consistency with NamespacedAttribute. * Fixed a test failure that occured on Python 3.x when chardet was installed. * Made prettify() return Unicode by default, so it will look nice on Python 3 when passed into print(). = 4.0.0b8 (20120224) = * All tree builders now preserve namespace information in the documents they parse. If you use the html5lib parser or lxml's XML parser, you can access the namespace URL for a tag as tag.namespace. However, there is no special support for namespace-oriented searching or tree manipulation. When you search the tree, you need to use namespace prefixes exactly as they're used in the original document. * The string representation of a DOCTYPE always ends in a newline. * Issue a warning if the user tries to use a SoupStrainer in conjunction with the html5lib tree builder, which doesn't support them. = 4.0.0b7 (20120223) = * Upon decoding to string, any characters that can't be represented in your chosen encoding will be converted into numeric XML entity references. * Issue a warning if characters were replaced with REPLACEMENT CHARACTER during Unicode conversion. * Restored compatibility with Python 2.6. * The install process no longer installs docs or auxillary text files. * It's now possible to deepcopy a BeautifulSoup object created with Python's built-in HTML parser. * About 100 unit tests that "test" the behavior of various parsers on invalid markup have been removed. Legitimate changes to those parsers caused these tests to fail, indicating that perhaps Beautiful Soup should not test the behavior of foreign libraries. The problematic unit tests have been reformulated as informational comparisons generated by the script scripts/demonstrate_parser_differences.py. This makes Beautiful Soup compatible with html5lib version 0.95 and future versions of HTMLParser. = 4.0.0b6 (20120216) = * Multi-valued attributes like "class" always have a list of values, even if there's only one value in the list. * Added a number of multi-valued attributes defined in HTML5. * Stopped generating a space before the slash that closes an empty-element tag. This may come back if I add a special XHTML mode (http://www.w3.org/TR/xhtml1/#C_2), but right now it's pretty useless. * Passing text along with tag-specific arguments to a find* method: find("a", text="Click here") will find tags that contain the given text as their .string. Previously, the tag-specific arguments were ignored and only strings were searched. * Fixed a bug that caused the html5lib tree builder to build a partially disconnected tree. Generally cleaned up the html5lib tree builder. * If you restrict a multi-valued attribute like "class" to a string that contains spaces, Beautiful Soup will only consider it a match if the values correspond to that specific string. = 4.0.0b5 (20120209) = * Rationalized Beautiful Soup's treatment of CSS class. A tag belonging to multiple CSS classes is treated as having a list of values for the 'class' attribute. Searching for a CSS class will match *any* of the CSS classes. This actually affects all attributes that the HTML standard defines as taking multiple values (class, rel, rev, archive, accept-charset, and headers), but 'class' is by far the most common. [bug=41034] * If you pass anything other than a dictionary as the second argument to one of the find* methods, it'll assume you want to use that object to search against a tag's CSS classes. Previously this only worked if you passed in a string. * Fixed a bug that caused a crash when you passed a dictionary as an attribute value (possibly because you mistyped "attrs"). [bug=842419] * Unicode, Dammit now detects the encoding in HTML 5-style <meta> tags like <meta charset="utf-8" />. [bug=837268] * If Unicode, Dammit can't figure out a consistent encoding for a page, it will try each of its guesses again, with errors="replace" instead of errors="strict". This may mean that some data gets replaced with REPLACEMENT CHARACTER, but at least most of it will get turned into Unicode. [bug=754903] * Patched over a bug in html5lib (?) that was crashing Beautiful Soup on certain kinds of markup. [bug=838800] * Fixed a bug that wrecked the tree if you replaced an element with an empty string. [bug=728697] * Improved Unicode, Dammit's behavior when you give it Unicode to begin with. = 4.0.0b4 (20120208) = * Added BeautifulSoup.new_string() to go along with BeautifulSoup.new_tag() * BeautifulSoup.new_tag() will follow the rules of whatever tree-builder was used to create the original BeautifulSoup object. A new <p> tag will look like "<p />" if the soup object was created to parse XML, but it will look like "<p></p>" if the soup object was created to parse HTML. * We pass in strict=False to html.parser on Python 3, greatly improving html.parser's ability to handle bad HTML. * We also monkeypatch a serious bug in html.parser that made strict=False disastrous on Python 3.2.2. * Replaced the "substitute_html_entities" argument with the more general "formatter" argument. * Bare ampersands and angle brackets are always converted to XML entities unless the user prevents it. * Added PageElement.insert_before() and PageElement.insert_after(), which let you put an element into the parse tree with respect to some other element. * Raise an exception when the user tries to do something nonsensical like insert a tag into itself. = 4.0.0b3 (20120203) = Beautiful Soup 4 is a nearly-complete rewrite that removes Beautiful Soup's custom HTML parser in favor of a system that lets you write a little glue code and plug in any HTML or XML parser you want. Beautiful Soup 4.0 comes with glue code for four parsers: * Python's standard HTMLParser (html.parser in Python 3) * lxml's HTML and XML parsers * html5lib's HTML parser HTMLParser is the default, but I recommend you install lxml if you can. For complete documentation, see the Sphinx documentation in bs4/doc/source/. What follows is a summary of the changes from Beautiful Soup 3. === The module name has changed === Previously you imported the BeautifulSoup class from a module also called BeautifulSoup. To save keystrokes and make it clear which version of the API is in use, the module is now called 'bs4': >>> from bs4 import BeautifulSoup === It works with Python 3 === Beautiful Soup 3.1.0 worked with Python 3, but the parser it used was so bad that it barely worked at all. Beautiful Soup 4 works with Python 3, and since its parser is pluggable, you don't sacrifice quality. Special thanks to Thomas Kluyver and Ezio Melotti for getting Python 3 support to the finish line. Ezio Melotti is also to thank for greatly improving the HTML parser that comes with Python 3.2. === CDATA sections are normal text, if they're understood at all. === Currently, the lxml and html5lib HTML parsers ignore CDATA sections in markup: <p><![CDATA[foo]]></p> => <p></p> A future version of html5lib will turn CDATA sections into text nodes, but only within tags like <svg> and <math>: <svg><![CDATA[foo]]></svg> => <p>foo</p> The default XML parser (which uses lxml behind the scenes) turns CDATA sections into ordinary text elements: <p><![CDATA[foo]]></p> => <p>foo</p> In theory it's possible to preserve the CDATA sections when using the XML parser, but I don't see how to get it to work in practice. === Miscellaneous other stuff === If the BeautifulSoup instance has .is_xml set to True, an appropriate XML declaration will be emitted when the tree is transformed into a string: <?xml version="1.0" encoding="utf-8"> <markup> ... </markup> The ['lxml', 'xml'] tree builder sets .is_xml to True; the other tree builders set it to False. If you want to parse XHTML with an HTML parser, you can set it manually.
2012-06-03 23:29:57 +02:00
MAINTAINER= pkgsrc-users@NetBSD.org
HOMEPAGE= http://www.crummy.com/software/BeautifulSoup/
COMMENT= HTML/XML Parser for Python, version 4
LICENSE= modified-bsd
DEPENDS+= ${PYPKGPREFIX}-lxml-[0-9]*:../../textproc/py-lxml
do-test:
cd ${WRKSRC} && ${PYTHONBIN} -m unittest discover -s bs4
.include "../../lang/python/distutils.mk"
.include "../../mk/bsd.pkg.mk"
Reference in a new issue Copy permalink