Commit graph

289 commits

Author SHA1 Message Date
rillig
276bc87b64 mk/fetch: add SITES.* to the variables for the show-all-fetch target 2019-11-22 19:30:23 +00:00
rillig
af0890f6c6 mk/fetch: sort variables for bmake show-all-github 2019-11-04 19:05:18 +00:00
rillig
629d9c85db doc/guide: fill in the MASTER_SITE variables automatically
Keeping these two lists in sync is not something that humans should do.
2019-05-05 18:36:05 +00:00
wiz
ffb5aa8ddc *: mirror.switch.ch does not provide ftp/http service any longer 2019-02-04 09:36:41 +00:00
tnn
22ac324162 mk/sites: cpan.perl.org advertises Strict-Transport-Security 2019-01-14 09:46:58 +00:00
rillig
858c6cfd69 mk/misc: make configuration for show-all targets more configurable
Up to now, there was a central list of variable name patterns that
defined whether a variable was printed as a sorted list, as a list or as
a single value.

Now each variable group decides on its own which of the variables are
printed in which way, using the usual glob patterns. This is more
flexible since different files sometimes differ in their naming
conventions.

Two variable groups are added: license (for everything related to
LICENSE) and go (for lang/go).
2018-11-30 18:38:19 +00:00
maya
8d0e197859 Remove dead mozilla mirrors. ESR mirrors are not used. 2018-10-23 23:22:31 +00:00
maya
637d08c6eb drop ftp://ftp.gnu.org, they have a notice stating they intend to shut down
ftp services. (http remains)
2018-10-13 02:46:11 +00:00
maya
6c25dec844 Remove clauses 3,4 from TNF-only copyright blocks.
This is based on the decision The NetBSD Foundation made in 2008 to
do so, which was already applied to src.

This change has been applied to code which is likely not in other
repositories.

ok board@, reviewed by riastradh@
2018-08-22 20:48:36 +00:00
rillig
3866b420a6 mk/fetch/github.mk: document that PKGBASE influences GitHub variables
See https://mail-index.netbsd.org/pkgsrc-users/2018/07/thread1.html#027251
2018-08-01 18:01:32 +00:00
wiz
f367007762 *: gd.tuwien.ac.at/ftp.tuwien.ac.at is gone, remove it from various mastersites 2018-04-21 13:38:04 +00:00
rillig
81c4fbd48d mk/fetch: add documentation for show-all-github 2018-04-08 20:39:47 +00:00
maya
192d0ba9af Reorder MASTER_SITES_GNU:
- Put the main mirror at the lowest priority. it seems to be struggling.
- Add two mirrors that seem decent at the highest priority.
2018-02-18 19:31:56 +00:00
alnsn
cbe853ca6d Add FETCH_PROXY and FETCH_PROXY.{ftp,http,https}. 2018-01-11 08:54:37 +00:00
wiz
e9d95506d5 mk: Remove ftp.kddlabs.co.jp from sites, does not provide ftp service 2017-12-03 11:01:19 +00:00
tnn
e5b08a6647 define MASTER_SITE_CRATESIO (for downloading rust crates) 2017-11-08 11:58:02 +00:00
maya
58176b4461 remove ftp variant when http server already exists
pretty sure these are the same server but ftp is considerably slower on
a high latency connection
2017-09-29 06:17:12 +00:00
wiz
371e3139fb fetch/sites.mk: ftp.tuwien.ac.at times out, remove it 2017-09-17 10:55:17 +00:00
hauke
2711324a88 Update MASTER_SITE_XEMACS list. 2017-08-10 12:21:18 +00:00
jperkin
007ae9858c Do not perform checksum tests when explicitly calling a make target that
creates or updates the checksum.  Allows users to set FAILOVER_FETCH in
mk.conf unconditionally and be able to update distinfo files without
first having to remove them.
2017-08-01 13:15:32 +00:00
maya
2b5f2f1662 Reorder so cpan http mirrors are first
at least with nbftp, ftp downloads involve several slow back and forth 'cd'
commands and end up being noticeably slower for lots of little files
2017-06-12 07:13:35 +00:00
maya
e5900c2b7d replace ftp at kernel.org with http. it will shut down soon. 2017-01-28 00:23:35 +00:00
hauke
16ed67bd37 Update MASTER_SITE_XEMACS:
- remove three defunct mirrors
- remove xemacs.org - its hoster tux.org went down,
  and the master site as well as all the *.xemacs.org
  DNS entries are gone
- add two mirrors that run under their own domain name
2016-12-11 19:19:36 +00:00
wiz
db05d33e02 Remove ex-CPAN mirror. 2016-12-04 18:26:44 +00:00
wiz
2c38733c3a Remove outdated netlib mirror. 2016-10-18 14:03:16 +00:00
wiz
89b7279e32 Remove ftp.tex.ac.uk, it does not allow connections. 2016-09-11 13:04:28 +00:00
asau
8ed2939d16 Handle special case of URLs prepended with dash. 2016-08-09 15:16:35 +00:00
wiz
52d4a1294a Remove some non-working sunsite mirrors (and a mirror of something else) 2016-08-01 09:35:56 +00:00
mspo
dd873a033d add ftp6 into the list of MASTER_SITE_BACKUP 2016-06-16 18:23:01 +00:00
mspo
521ef20129 add cdn.netbsd.org to the top of MASTER_SITE_BACKUP 2016-06-16 00:13:38 +00:00
wiz
40b7c6735c Update URL to new pypi master site. 2016-06-01 12:40:06 +00:00
wiz
1cdbd2a052 Fix MASTER_SITES example. 2016-06-01 12:39:40 +00:00
wiz
8c393357d6 Remove dm-download02.mozilla.org, it doesn't resolve. 2016-05-29 12:17:53 +00:00
wiz
e3a623858d ftp.OpenBSD.org does not provide public ftp any longer, only http. 2016-05-17 09:28:06 +00:00
ryoon
f5a6e41c04 Add some osdn.jp mirror sites 2016-04-17 09:10:02 +00:00
taca
0f21f3b206 Update MASTER_SITE_RUBYGEMS to avoid extra redirection. 2016-02-14 06:55:08 +00:00
mef
df83c2aea0 mysql.llarian.net is not on DNS record of llarian.net 2016-01-23 02:46:39 +00:00
zafer
e33ff3d3ae update sites.mk. remove non-working mirrors. 2016-01-22 07:56:01 +00:00
dholland
ed95567cee Use :tA to make DISTINFO_FILE absolute when passing it to the fetch
and checksum scripts.

Fixes the problem where DISTINFO_FILE=../../foo/bar/distinfo doesn't
work without having an extraneous and ugly ${.CURDIR} stuffed into it
by hand.
2016-01-06 07:38:25 +00:00
tnn
351c726fe7 Don't encode the github tag into the distfile name if we are packaging
a github release and the release version happens to look like a tag.
(a date like 20150714 could be misinterpreted as a git "short SHA")
2015-10-19 14:24:26 +00:00
ryoon
955e585ec0 Update MASTER_SITE_OSDN server names. 2015-10-10 15:17:17 +00:00
dsainty
004b23284b Alter the behaviour of the "fetch" executable to accept zero download sites
as an acceptable input.

Fixes Pkgsrc for users that set PKG_RESUME_TRANSFERS=yes in their mk.conf if
installing a package that has an interactive fetch stage, after
mk/fetch/fetch.mk revision 1.66.

Tested for all combinations of:

+ PKG_RESUME_TRANSFERS=yes/no; and
+ interactive fetch=yes/no; and
+ distfile=downloaded/not downloaded

... with no signs of misbehaviour.

The specific case that was broken, and this change fixes, is:

+ PKG_RESUME_TRANSFERS=yes; and
+ interactive fetch=yes; and
+ distfile=downloaded

This change was designed with the following considerations:

1. Given it's a freeze, keep it simple.

2. The change in behaviour allows 'fetch' to succeed where it would previously
   fail fatally, so it's unlikely to affect any (intentional) existing
   behaviour in Pkgsrc.

3. The behaviour of 'fetch' with zero sites is essentially the same as a
   fetch where all the possible download sites fail, I.e. Pkgsrc already
   expects to handle such behaviour.

ok gdt@
2015-09-19 11:45:56 +00:00
joerg
cfc3e94d33 Reorder and fix logic snafu. 2015-09-14 08:27:13 +00:00
joerg
7612f47233 Introduce IGNORE_INTERACTIVE_FETCH to allow trying to fetch files from
the override site, even for INTERACTIVE_STATE=stage or FETCH_MESSAGE.
Ignore all backup sites as they won't have the distfile anyway, the
fetch wouldn't be interactive in first place otherwise.
2015-09-13 15:03:57 +00:00
joerg
d047710b53 Make the post-fetch hook a bit more useful by also handing down the URL
the file was obtained from. This makes it easier to skip any local
mirrors.
2015-09-08 12:37:56 +00:00
joerg
0cf087a0ae Add a hook for running an action after a successful fetch.
This is intended for keeping distfile archives synchronised between
different machines without requiring NFS mounts or the like.
2015-09-08 11:13:12 +00:00
ryoon
618d723ff4 Anonymous ftp service of ftp.mozilla.org is no longer provided. 2015-08-11 23:41:41 +00:00
rodent
37cc4aac9e Add https://download.gnome.org/ to MASTER_SITES_GNOME. 2015-07-12 20:29:58 +00:00
ryoon
2ed142506d Sort. Move ODSN mirror. 2015-07-11 07:05:39 +00:00
rodent
9581e66cf1 Enabling handling of pypi packages. No opposing comments received in
private mail nor on tech-pkg@ since the posting. Will begin the slow
transition of packages to use this feature as they're updated.
2015-07-06 05:03:33 +00:00