McSinyx/pip
1
1
Fork 0
mirror of https://github.com/pypa/pip synced 2023-12-13 21:30:23 +01:00
Code Issues Releases Activity
pip/tests/unit/test_index.py

161 lines
5.1 KiB
Python
Raw Normal View History

Ignores invalid urls with warning for non-existing paths or url without scheme closes #2968
2015-12-04 22:34:42 +01:00
import os.path
Fix #1101 - Properly handle a <base> without a href
2014-06-13 13:28:05 +02:00
Sort all imports
2017-05-16 12:16:30 +02:00
import pytest
Convert base_url property into local variable This property is only used in HTMLPage.links, which is only called once per instance in PackageFinder.find_all_candidates(). This would not affect performance or behavior, but improves data locality. The unit test of this property is and modified to test the underlying function instead.
2018-09-28 08:56:34 +02:00
from pip._vendor import html5lib
Sort imports and minor Flake8 changes (#4520) * Run isort on the codebase Command: isort --recursive --skip __main__.py --skip _vendor -o pip._vendor -sd THIRDPARTY -m 5 -p pip -p tests ./pip ./tests * :newspaper:
2017-06-13 14:17:00 +02:00
Move all internal APIs to pip._internal
2017-08-31 17:48:18 +02:00
from pip._internal.download import PipSession
Rename base URL detection function
2018-09-28 10:48:08 +02:00
from pip._internal.index import Link, PackageFinder, _determine_base_url
merged Jon Parise's contrib and added tests to `pip.index.package_to_requirement` function
2011-02-10 02:28:34 +01:00
Fix whitespace, etc for pep8 compliance Reran tests after changes on 2.4, 2.6, 3.2 all pass. ===================================================== ================== Running pep8 ===================== Searching for pep8 Reading http://pypi.python.org/simple/pep8/ Reading http://github.com/cburroughs/pep8.py/tree/master Reading http://github.com/jcrocholl/pep8 Best match: pep8 0.6.1 Processing pep8-0.6.1-py2.6.egg pep8 0.6.1 is already the active version in easy-install.pth Installing pep8 script to /Users/pnasrat/Development/pip/pip_virtualenv/bin Using /Users/pnasrat/Development/pip/pip_virtualenv/lib/python2.6/site-packages/pep8-0.6.1-py2.6.egg Processing dependencies for pep8 Finished processing dependencies for pep8 ==================== Ended pep8 ===================== =====================================================
2011-05-04 09:44:02 +02:00
add expand_dir arg to _sort_locations
2015-04-06 20:18:22 +02:00
def test_sort_locations_file_expand_dir(data):
file:// related tests
2012-09-17 02:45:16 +02:00
"""
add expand_dir arg to _sort_locations
2015-04-06 20:18:22 +02:00
Test that a file:// dir gets listdir run with expand_dir
file:// related tests
2012-09-17 02:45:16 +02:00
"""
Require an already created session to be passed into APIs
2014-05-07 01:25:44 +02:00
finder = PackageFinder([data.find_links], [], session=PipSession())
add expand_dir arg to _sort_locations
2015-04-06 20:18:22 +02:00
files, urls = finder._sort_locations([data.find_links], expand_dir=True)
Use Flake8 on the test of pip's Python files
2014-01-28 15:17:51 +01:00
assert files and not urls, (
"files and not urls should have been found at find-links url: %s" %
data.find_links
)
correct import for py3x and better assertions
2012-09-17 07:42:30 +02:00
Isolate the tests from the shared data directory
2013-08-23 13:12:37 +02:00
def test_sort_locations_file_not_find_link(data):
correct import for py3x and better assertions
2012-09-17 07:42:30 +02:00
"""
Use Flake8 on the test of pip's Python files
2014-01-28 15:17:51 +01:00
Test that a file:// url dir that's not a find-link, doesn't get a listdir
run
correct import for py3x and better assertions
2012-09-17 07:42:30 +02:00
"""
Require an already created session to be passed into APIs
2014-05-07 01:25:44 +02:00
finder = PackageFinder([], [], session=PipSession())
Fix test_sort_locations_file_not_find_link test _sort_locations expects a list
2015-12-04 22:36:52 +01:00
files, urls = finder._sort_locations([data.index_url("empty_with_pkg")])
correct import for py3x and better assertions
2012-09-17 07:42:30 +02:00
assert urls and not files, "urls, but not files should have been found"
file:// related tests
2012-09-17 02:45:16 +02:00
Ignores invalid urls with warning for non-existing paths or url without scheme closes #2968
2015-12-04 22:34:42 +01:00
def test_sort_locations_non_existing_path():
"""
Test that a non-existing path is ignored.
"""
finder = PackageFinder([], [], session=PipSession())
files, urls = finder._sort_locations(
[os.path.join('this', 'doesnt', 'exist')])
assert not urls and not files, "nothing should have been found"
- if installing directly from a wheel, fail if it has an invalid name or is unsupported - when walking links, skip invalid wheel filenames, don't crash
2013-11-15 01:35:24 +01:00
class TestLink(object):
def test_splitext(self):
assert ('wheel', '.whl') == Link('http://yo/wheel.whl').splitext()
Ensure that Link().filename returns an unquoted filename
2014-12-19 01:44:26 +01:00
@pytest.mark.parametrize(
("url", "expected"),
[
("http://yo/wheel.whl", "wheel.whl"),
("http://yo/wheel", "wheel"),
(
"http://yo/myproject-1.0%2Bfoobar.0-py2.py3-none-any.whl",
"myproject-1.0+foobar.0-py2.py3-none-any.whl",
),
],
)
def test_filename(self, url, expected):
assert Link(url).filename == expected
- if installing directly from a wheel, fail if it has an invalid name or is unsupported - when walking links, skip invalid wheel filenames, don't crash
2013-11-15 01:35:24 +01:00
def test_no_ext(self):
assert '' == Link('http://yo/wheel').ext
def test_ext(self):
assert '.whl' == Link('http://yo/wheel.whl').ext
def test_ext_fragment(self):
assert '.whl' == Link('http://yo/wheel.whl#frag').ext
def test_ext_query(self):
assert '.whl' == Link('http://yo/wheel.whl?a=b').ext
Fix #1101 - Properly handle a <base> without a href
2014-06-13 13:28:05 +02:00
add is_wheel method to Link class
2014-12-28 23:52:32 +01:00
def test_is_wheel(self):
assert Link('http://yo/wheel.whl').is_wheel
add missing test of is_wheel False evaluation
2015-03-06 23:46:44 +01:00
def test_is_wheel_false(self):
assert not Link('http://yo/not_a_wheel').is_wheel
add test for link fragments
2016-02-09 15:53:42 +01:00
def test_fragments(self):
url = 'git+https://example.com/package#egg=eggname'
assert 'eggname' == Link(url).egg_fragment
assert None is Link(url).subdirectory_fragment
url = 'git+https://example.com/package#egg=eggname&subdirectory=subdir'
assert 'eggname' == Link(url).egg_fragment
assert 'subdir' == Link(url).subdirectory_fragment
url = 'git+https://example.com/package#subdirectory=subdir&egg=eggname'
assert 'eggname' == Link(url).egg_fragment
assert 'subdir' == Link(url).subdirectory_fragment
Fix #1101 - Properly handle a <base> without a href
2014-06-13 13:28:05 +02:00
@pytest.mark.parametrize(
("html", "url", "expected"),
[
Upgrade Dependencies (#4038) * Upgrade distlib to 0.2.4 * Upgrade distro to 1.0.0 * Upgrade html5lib to 1.0b10 * Upgrade requests to 2.11.1 * Upgrade CacheControl to 0.11.7 * Upgrade ipaddress to 1.0.17 * Upgrade pyparsing to 2.1.10 * Upgrade packaging to 16.8 * Add webencodings 0.5 * Add ordereddict 1.1
2016-10-30 06:35:28 +01:00
(b"<html></html>", "https://example.com/", "https://example.com/"),
Fix #1101 - Properly handle a <base> without a href
2014-06-13 13:28:05 +02:00
(
Upgrade Dependencies (#4038) * Upgrade distlib to 0.2.4 * Upgrade distro to 1.0.0 * Upgrade html5lib to 1.0b10 * Upgrade requests to 2.11.1 * Upgrade CacheControl to 0.11.7 * Upgrade ipaddress to 1.0.17 * Upgrade pyparsing to 2.1.10 * Upgrade packaging to 16.8 * Add webencodings 0.5 * Add ordereddict 1.1
2016-10-30 06:35:28 +01:00
b"<html><head>"
b"<base href=\"https://foo.example.com/\">"
b"</head></html>",
Fix #1101 - Properly handle a <base> without a href
2014-06-13 13:28:05 +02:00
"https://example.com/",
"https://foo.example.com/",
),
(
Upgrade Dependencies (#4038) * Upgrade distlib to 0.2.4 * Upgrade distro to 1.0.0 * Upgrade html5lib to 1.0b10 * Upgrade requests to 2.11.1 * Upgrade CacheControl to 0.11.7 * Upgrade ipaddress to 1.0.17 * Upgrade pyparsing to 2.1.10 * Upgrade packaging to 16.8 * Add webencodings 0.5 * Add ordereddict 1.1
2016-10-30 06:35:28 +01:00
b"<html><head>"
b"<base><base href=\"https://foo.example.com/\">"
b"</head></html>",
Fix #1101 - Properly handle a <base> without a href
2014-06-13 13:28:05 +02:00
"https://example.com/",
"https://foo.example.com/",
),
],
)
Rename base URL detection function
2018-09-28 10:48:08 +02:00
def test_determine_base_url(html, url, expected):
Convert base_url property into local variable This property is only used in HTMLPage.links, which is only called once per instance in PackageFinder.find_all_candidates(). This would not affect performance or behavior, but improves data locality. The unit test of this property is and modified to test the underlying function instead.
2018-09-28 08:56:34 +02:00
document = html5lib.parse(
html, transport_encoding=None, namespaceHTMLElements=False,
)
Rename base URL detection function
2018-09-28 10:48:08 +02:00
assert _determine_base_url(document, url) == expected
don't complain about localhost when checking security of index links based entirely off of Guy Rozendorn's work in PR #1718
2014-08-11 06:21:02 +02:00
class MockLogger(object):
def __init__(self):
self.called = False
Deprecate accessing non secure origins by default * Deprecates accessing non secure origins by default, the list of which is taken from Chrome. * Adds a --trusted-host flag to enable users to mark a specific host as a secure origin regardless of what we think. * Refactors the original warning to better indicate the intent and the new flag.
2014-12-10 01:40:05 +01:00
def warning(self, *args, **kwargs):
don't complain about localhost when checking security of index links based entirely off of Guy Rozendorn's work in PR #1718
2014-08-11 06:21:02 +02:00
self.called = True
Deprecate accessing non secure origins by default * Deprecates accessing non secure origins by default, the list of which is taken from Chrome. * Adds a --trusted-host flag to enable users to mark a specific host as a secure origin regardless of what we think. * Refactors the original warning to better indicate the intent and the new flag.
2014-12-10 01:40:05 +01:00
@pytest.mark.parametrize(
("location", "trusted", "expected"),
[
Switch pip to use Warehouse by default
2018-04-13 14:08:51 +02:00
("http://pypi.org/something", [], True),
("https://pypi.org/something", [], False),
("git+http://pypi.org/something", [], True),
("git+https://pypi.org/something", [], False),
("git+ssh://git@pypi.org/something", [], False),
Deprecate accessing non secure origins by default * Deprecates accessing non secure origins by default, the list of which is taken from Chrome. * Adds a --trusted-host flag to enable users to mark a specific host as a secure origin regardless of what we think. * Refactors the original warning to better indicate the intent and the new flag.
2014-12-10 01:40:05 +01:00
("http://localhost", [], False),
("http://127.0.0.1", [], False),
("http://example.com/something/", [], True),
("http://example.com/something/", ["example.com"], False),
Case-insensitive match secure origin names DNS is non-case-sensitive, so case mismatches between origin names and any declared trusted hosts are also irrelevant.
2016-01-29 22:31:19 +01:00
("http://eXample.com/something/", ["example.cOm"], False),
Deprecate accessing non secure origins by default * Deprecates accessing non secure origins by default, the list of which is taken from Chrome. * Adds a --trusted-host flag to enable users to mark a specific host as a secure origin regardless of what we think. * Refactors the original warning to better indicate the intent and the new flag.
2014-12-10 01:40:05 +01:00
],
)
def test_secure_origin(location, trusted, expected):
finder = PackageFinder([], [], session=[], trusted_hosts=trusted)
logger = MockLogger()
finder._validate_secure_origin(logger, location)
assert logger.called == expected
remove usernames and passwords for index URLs using basic auth from "Looking in indexes" log messages
2018-04-27 06:33:53 +02:00
def test_get_formatted_locations_basic_auth():
"""
Test that basic authentication credentials defined in URL
is not included in formatted output.
"""
index_urls = [
'https://pypi.org/simple',
'https://user:pass@repo.domain.com',
]
finder = PackageFinder([], index_urls, session=[])
result = finder.get_formatted_locations()
assert 'user' not in result and 'pass' not in result
Reference in a new issue Copy permalink