Commit graph

276 commits

Author SHA1 Message Date
alnsn
cbe853ca6d Add FETCH_PROXY and FETCH_PROXY.{ftp,http,https}. 2018-01-11 08:54:37 +00:00
wiz
e9d95506d5 mk: Remove ftp.kddlabs.co.jp from sites, does not provide ftp service 2017-12-03 11:01:19 +00:00
tnn
e5b08a6647 define MASTER_SITE_CRATESIO (for downloading rust crates) 2017-11-08 11:58:02 +00:00
maya
58176b4461 remove ftp variant when http server already exists
pretty sure these are the same server but ftp is considerably slower on
a high latency connection
2017-09-29 06:17:12 +00:00
wiz
371e3139fb fetch/sites.mk: ftp.tuwien.ac.at times out, remove it 2017-09-17 10:55:17 +00:00
hauke
2711324a88 Update MASTER_SITE_XEMACS list. 2017-08-10 12:21:18 +00:00
jperkin
007ae9858c Do not perform checksum tests when explicitly calling a make target that
creates or updates the checksum.  Allows users to set FAILOVER_FETCH in
mk.conf unconditionally and be able to update distinfo files without
first having to remove them.
2017-08-01 13:15:32 +00:00
maya
2b5f2f1662 Reorder so cpan http mirrors are first
at least with nbftp, ftp downloads involve several slow back and forth 'cd'
commands and end up being noticeably slower for lots of little files
2017-06-12 07:13:35 +00:00
maya
e5900c2b7d replace ftp at kernel.org with http. it will shut down soon. 2017-01-28 00:23:35 +00:00
hauke
16ed67bd37 Update MASTER_SITE_XEMACS:
- remove three defunct mirrors
- remove xemacs.org - its hoster tux.org went down,
  and the master site as well as all the *.xemacs.org
  DNS entries are gone
- add two mirrors that run under their own domain name
2016-12-11 19:19:36 +00:00
wiz
db05d33e02 Remove ex-CPAN mirror. 2016-12-04 18:26:44 +00:00
wiz
2c38733c3a Remove outdated netlib mirror. 2016-10-18 14:03:16 +00:00
wiz
89b7279e32 Remove ftp.tex.ac.uk, it does not allow connections. 2016-09-11 13:04:28 +00:00
asau
8ed2939d16 Handle special case of URLs prepended with dash. 2016-08-09 15:16:35 +00:00
wiz
52d4a1294a Remove some non-working sunsite mirrors (and a mirror of something else) 2016-08-01 09:35:56 +00:00
mspo
dd873a033d add ftp6 into the list of MASTER_SITE_BACKUP 2016-06-16 18:23:01 +00:00
mspo
521ef20129 add cdn.netbsd.org to the top of MASTER_SITE_BACKUP 2016-06-16 00:13:38 +00:00
wiz
40b7c6735c Update URL to new pypi master site. 2016-06-01 12:40:06 +00:00
wiz
1cdbd2a052 Fix MASTER_SITES example. 2016-06-01 12:39:40 +00:00
wiz
8c393357d6 Remove dm-download02.mozilla.org, it doesn't resolve. 2016-05-29 12:17:53 +00:00
wiz
e3a623858d ftp.OpenBSD.org does not provide public ftp any longer, only http. 2016-05-17 09:28:06 +00:00
ryoon
f5a6e41c04 Add some osdn.jp mirror sites 2016-04-17 09:10:02 +00:00
taca
0f21f3b206 Update MASTER_SITE_RUBYGEMS to avoid extra redirection. 2016-02-14 06:55:08 +00:00
mef
df83c2aea0 mysql.llarian.net is not on DNS record of llarian.net 2016-01-23 02:46:39 +00:00
zafer
e33ff3d3ae update sites.mk. remove non-working mirrors. 2016-01-22 07:56:01 +00:00
dholland
ed95567cee Use :tA to make DISTINFO_FILE absolute when passing it to the fetch
and checksum scripts.

Fixes the problem where DISTINFO_FILE=../../foo/bar/distinfo doesn't
work without having an extraneous and ugly ${.CURDIR} stuffed into it
by hand.
2016-01-06 07:38:25 +00:00
tnn
351c726fe7 Don't encode the github tag into the distfile name if we are packaging
a github release and the release version happens to look like a tag.
(a date like 20150714 could be misinterpreted as a git "short SHA")
2015-10-19 14:24:26 +00:00
ryoon
955e585ec0 Update MASTER_SITE_OSDN server names. 2015-10-10 15:17:17 +00:00
dsainty
004b23284b Alter the behaviour of the "fetch" executable to accept zero download sites
as an acceptable input.

Fixes Pkgsrc for users that set PKG_RESUME_TRANSFERS=yes in their mk.conf if
installing a package that has an interactive fetch stage, after
mk/fetch/fetch.mk revision 1.66.

Tested for all combinations of:

+ PKG_RESUME_TRANSFERS=yes/no; and
+ interactive fetch=yes/no; and
+ distfile=downloaded/not downloaded

... with no signs of misbehaviour.

The specific case that was broken, and this change fixes, is:

+ PKG_RESUME_TRANSFERS=yes; and
+ interactive fetch=yes; and
+ distfile=downloaded

This change was designed with the following considerations:

1. Given it's a freeze, keep it simple.

2. The change in behaviour allows 'fetch' to succeed where it would previously
   fail fatally, so it's unlikely to affect any (intentional) existing
   behaviour in Pkgsrc.

3. The behaviour of 'fetch' with zero sites is essentially the same as a
   fetch where all the possible download sites fail, I.e. Pkgsrc already
   expects to handle such behaviour.

ok gdt@
2015-09-19 11:45:56 +00:00
joerg
cfc3e94d33 Reorder and fix logic snafu. 2015-09-14 08:27:13 +00:00
joerg
7612f47233 Introduce IGNORE_INTERACTIVE_FETCH to allow trying to fetch files from
the override site, even for INTERACTIVE_STATE=stage or FETCH_MESSAGE.
Ignore all backup sites as they won't have the distfile anyway, the
fetch wouldn't be interactive in first place otherwise.
2015-09-13 15:03:57 +00:00
joerg
d047710b53 Make the post-fetch hook a bit more useful by also handing down the URL
the file was obtained from. This makes it easier to skip any local
mirrors.
2015-09-08 12:37:56 +00:00
joerg
0cf087a0ae Add a hook for running an action after a successful fetch.
This is intended for keeping distfile archives synchronised between
different machines without requiring NFS mounts or the like.
2015-09-08 11:13:12 +00:00
ryoon
618d723ff4 Anonymous ftp service of ftp.mozilla.org is no longer provided. 2015-08-11 23:41:41 +00:00
rodent
37cc4aac9e Add https://download.gnome.org/ to MASTER_SITES_GNOME. 2015-07-12 20:29:58 +00:00
ryoon
2ed142506d Sort. Move ODSN mirror. 2015-07-11 07:05:39 +00:00
rodent
9581e66cf1 Enabling handling of pypi packages. No opposing comments received in
private mail nor on tech-pkg@ since the posting. Will begin the slow
transition of packages to use this feature as they're updated.
2015-07-06 05:03:33 +00:00
rodent
8fca1d2848 Add support for Python Package Index (pypi) master site handling.
This is commented for now in bsd.fetch.mk pending 48 hours of feedback on
tech-pkg@.
2015-07-01 00:55:34 +00:00
rodent
65254ed423 pkglint didn't like my proposed format for this file.
Reverting to convention.
2015-07-01 00:45:35 +00:00
rodent
dba05b1b20 Add MASTER_SITE_PYPI, which is going to be used in pypi.mk in a bit.
This entire file needs:
	1) collation;
	2) the EOL escapes removed and turned into proper lists;

Otherwise, it's a bit painful to read.
2015-06-30 23:11:18 +00:00
ryoon
7110bb1f60 Rename MASTER_SITE_SOURCEFORGE_JP to MASTER_SITE_OSDN.
sourceforge.jp is renamed to osdn.jp.
However its mirror sites are not ready for osdn.jp.
2015-06-29 11:06:46 +00:00
tsutsui
9dbfb4af6e ftp.dti.ad.jp is not working for several years.
Per debian-mirrors:
https://lists.debian.org/debian-mirrors/2014/07/msg00013.html
2015-05-16 20:02:21 +00:00
mef
b7f0fcc7ec I believe this is correct -> ftp://ftp.kde.org to http://download.kde.org 2015-05-04 12:20:43 +00:00
dsainty
0757ea0f74 As discussed on-list, remove www.ibiblio.org from MASTER_SITE_APACHE so that
its habit of returning HTTP 200 on files it doesn't have will not corrupt
resuming file downloads.

Also remove from MASTER_SITE_OPENOFFICE, for the same reason and also because
their openoffice mirror appears empty anyway.

There are no other instances of www.ibiblio.org in the mirror lists.
2015-03-26 07:54:51 +00:00
tnn
68a7fc3fdc '-' is a valid character in github account names 2015-03-12 21:00:01 +00:00
tnn
976b7a048b Use SITES.${_GITHUB_DEFAULT_DISTFILES} instead of ugly := assignment
to MASTER_SITES which could conceivably break some use cases.
Also add comment in bsd.fetch-vars.mk.
2015-03-09 15:50:18 +00:00
tnn
5239c0ecd1 MASTER_SITE_GITHUB goes in sites.mk 2015-03-09 13:10:45 +00:00
tnn
c9632aa0f3 Address issues raised by agc@ to make the github master site handling
more pkgsrcesque.

1) turn _USE_GITHUB into an internal infrastructure variable
2) put back MASTER_SITES in packages' Makefiles.
3) encode the account in the master site URL, remove GH_ACCOUNT
4) rename GH_PROJECT to GITHUB_PROJECT
5) rename GH_TAGNAME to GITHUB_TAG and allow it to accept commit hash
   as well as tag. GH_COMMIT is gone.
6) turn on this functionality when MASTER_SITES matches a predefined github
   pattern instead of via explicit USE_GITHUB setting.
2015-03-07 21:14:32 +00:00
tnn
a687a51ddc use https. Unconditionally gets redirected to https, so saves a redirect. 2015-03-07 16:54:28 +00:00
tnn
c6ef0cef20 improve inline documentation 2015-03-07 16:17:42 +00:00