Commit graph

250 commits

Author SHA1 Message Date
tnn
351c726fe7 Don't encode the github tag into the distfile name if we are packaging
a github release and the release version happens to look like a tag.
(a date like 20150714 could be misinterpreted as a git "short SHA")
2015-10-19 14:24:26 +00:00
ryoon
955e585ec0 Update MASTER_SITE_OSDN server names. 2015-10-10 15:17:17 +00:00
dsainty
004b23284b Alter the behaviour of the "fetch" executable to accept zero download sites
as an acceptable input.

Fixes Pkgsrc for users that set PKG_RESUME_TRANSFERS=yes in their mk.conf if
installing a package that has an interactive fetch stage, after
mk/fetch/fetch.mk revision 1.66.

Tested for all combinations of:

+ PKG_RESUME_TRANSFERS=yes/no; and
+ interactive fetch=yes/no; and
+ distfile=downloaded/not downloaded

... with no signs of misbehaviour.

The specific case that was broken, and this change fixes, is:

+ PKG_RESUME_TRANSFERS=yes; and
+ interactive fetch=yes; and
+ distfile=downloaded

This change was designed with the following considerations:

1. Given it's a freeze, keep it simple.

2. The change in behaviour allows 'fetch' to succeed where it would previously
   fail fatally, so it's unlikely to affect any (intentional) existing
   behaviour in Pkgsrc.

3. The behaviour of 'fetch' with zero sites is essentially the same as a
   fetch where all the possible download sites fail, I.e. Pkgsrc already
   expects to handle such behaviour.

ok gdt@
2015-09-19 11:45:56 +00:00
joerg
cfc3e94d33 Reorder and fix logic snafu. 2015-09-14 08:27:13 +00:00
joerg
7612f47233 Introduce IGNORE_INTERACTIVE_FETCH to allow trying to fetch files from
the override site, even for INTERACTIVE_STATE=stage or FETCH_MESSAGE.
Ignore all backup sites as they won't have the distfile anyway, the
fetch wouldn't be interactive in first place otherwise.
2015-09-13 15:03:57 +00:00
joerg
d047710b53 Make the post-fetch hook a bit more useful by also handing down the URL
the file was obtained from. This makes it easier to skip any local
mirrors.
2015-09-08 12:37:56 +00:00
joerg
0cf087a0ae Add a hook for running an action after a successful fetch.
This is intended for keeping distfile archives synchronised between
different machines without requiring NFS mounts or the like.
2015-09-08 11:13:12 +00:00
ryoon
618d723ff4 Anonymous ftp service of ftp.mozilla.org is no longer provided. 2015-08-11 23:41:41 +00:00
rodent
37cc4aac9e Add https://download.gnome.org/ to MASTER_SITES_GNOME. 2015-07-12 20:29:58 +00:00
ryoon
2ed142506d Sort. Move ODSN mirror. 2015-07-11 07:05:39 +00:00
rodent
9581e66cf1 Enabling handling of pypi packages. No opposing comments received in
private mail nor on tech-pkg@ since the posting. Will begin the slow
transition of packages to use this feature as they're updated.
2015-07-06 05:03:33 +00:00
rodent
8fca1d2848 Add support for Python Package Index (pypi) master site handling.
This is commented for now in bsd.fetch.mk pending 48 hours of feedback on
tech-pkg@.
2015-07-01 00:55:34 +00:00
rodent
65254ed423 pkglint didn't like my proposed format for this file.
Reverting to convention.
2015-07-01 00:45:35 +00:00
rodent
dba05b1b20 Add MASTER_SITE_PYPI, which is going to be used in pypi.mk in a bit.
This entire file needs:
	1) collation;
	2) the EOL escapes removed and turned into proper lists;

Otherwise, it's a bit painful to read.
2015-06-30 23:11:18 +00:00
ryoon
7110bb1f60 Rename MASTER_SITE_SOURCEFORGE_JP to MASTER_SITE_OSDN.
sourceforge.jp is renamed to osdn.jp.
However its mirror sites are not ready for osdn.jp.
2015-06-29 11:06:46 +00:00
tsutsui
9dbfb4af6e ftp.dti.ad.jp is not working for several years.
Per debian-mirrors:
https://lists.debian.org/debian-mirrors/2014/07/msg00013.html
2015-05-16 20:02:21 +00:00
mef
b7f0fcc7ec I believe this is correct -> ftp://ftp.kde.org to http://download.kde.org 2015-05-04 12:20:43 +00:00
dsainty
0757ea0f74 As discussed on-list, remove www.ibiblio.org from MASTER_SITE_APACHE so that
its habit of returning HTTP 200 on files it doesn't have will not corrupt
resuming file downloads.

Also remove from MASTER_SITE_OPENOFFICE, for the same reason and also because
their openoffice mirror appears empty anyway.

There are no other instances of www.ibiblio.org in the mirror lists.
2015-03-26 07:54:51 +00:00
tnn
68a7fc3fdc '-' is a valid character in github account names 2015-03-12 21:00:01 +00:00
tnn
976b7a048b Use SITES.${_GITHUB_DEFAULT_DISTFILES} instead of ugly := assignment
to MASTER_SITES which could conceivably break some use cases.
Also add comment in bsd.fetch-vars.mk.
2015-03-09 15:50:18 +00:00
tnn
5239c0ecd1 MASTER_SITE_GITHUB goes in sites.mk 2015-03-09 13:10:45 +00:00
tnn
c9632aa0f3 Address issues raised by agc@ to make the github master site handling
more pkgsrcesque.

1) turn _USE_GITHUB into an internal infrastructure variable
2) put back MASTER_SITES in packages' Makefiles.
3) encode the account in the master site URL, remove GH_ACCOUNT
4) rename GH_PROJECT to GITHUB_PROJECT
5) rename GH_TAGNAME to GITHUB_TAG and allow it to accept commit hash
   as well as tag. GH_COMMIT is gone.
6) turn on this functionality when MASTER_SITES matches a predefined github
   pattern instead of via explicit USE_GITHUB setting.
2015-03-07 21:14:32 +00:00
tnn
a687a51ddc use https. Unconditionally gets redirected to https, so saves a redirect. 2015-03-07 16:54:28 +00:00
tnn
c6ef0cef20 improve inline documentation 2015-03-07 16:17:42 +00:00
tnn
7daa17b76d add keyword for make help 2015-03-07 15:31:52 +00:00
tnn
a5c5eb95d9 Adopt USE_GITHUB from FreeBSD ports to make github MASTER_SITE
handling less painful.
See: https://www.freebsd.org/doc/en_US.ISO8859-1/books/porters-handbook/makefile-distfiles.html#makefile-master_sites-github

To use, set in Makefile:

DISTNAME=	exampleproject-1.2
USE_GITHUB=	YES

The following variables alter USE_GITHUB behavior:

GH_ACCOUNT	defaults to PKGBASE
GH_PROJECT	defaults to PKGBASE
GH_TAGNAME	defaults to PKGVERSION_NOREV
		(sometimes you want to override with v${PKGVERSION_NOREV})
GH_COMMIT	explicit commit hash if no tag is available
GH_RELEASE	default empty, may be set to ${DISTNAME} for example
GH_TYPE		overrides the autodetected MASTER_SITE URL scheme
2015-03-07 14:17:51 +00:00
tnn
eb4a5426dc Update MASTER_SITE_FREEBSD and MASTER_SITE_FREEBSD_LOCAL as per
ftp://ftp.freebsd.org/pub/FreeBSD/ports/distfiles/README.txt and
ftp://ftp.freebsd.org/pub/FreeBSD/ports/local-distfiles/README.txt
respectively.
2015-03-06 21:11:09 +00:00
tnn
133ca6be16 close line 2015-03-06 20:58:47 +00:00
tnn
ca56801ab3 use ftp.fr.NetBSD.org instead of ftp.fi.NetBSD.org. ok bouyer@ 2015-03-06 20:58:17 +00:00
tnn
9c54f3616b Changes to MASTER_SITE_BACKUP:
1) Reduce preference of the primary master site:
   ftp://ftp.fi.NetBSD.org/pub/NetBSD/packages/distfiles/
   It seems to have stopped mirroring distfiles back in 2012 and we have
   been falling back to ftp.n.o anyway for years.
2) Remove the the FreeBSD backup master site as per instructions in
   ftp://ftp.freebsd.org/pub/FreeBSD/ports/distfiles/README.txt
   Unfortunately the new distcache service is not usable as it relies
   heavily on subdirectories.

We need to either contact Funet and ask them to start mirroring again or
get a different fast backup site in Europe.
2015-03-06 20:15:19 +00:00
tnn
c562e00818 prefer http for ftp.xemacs.org because passive FTP is broken 2015-03-06 18:01:28 +00:00
ryoon
e14fe0b55d mozilla.mirror.ac.za is empty. 2015-02-24 03:30:07 +00:00
ryoon
7a2c85b5f1 mirror.yandex.ru does not mirror mozilla/ anymore. 2015-02-24 03:28:41 +00:00
ryoon
94b4a86f39 ftp://releases.mozilla.org/ is not available anymore. 2015-02-24 03:26:44 +00:00
mef
9a94e65dcc mysql.skynet.be for MASTER_SITE_MYSQL does not seem to available. Drop two lines. 2015-02-21 14:46:08 +00:00
jperkin
71d3100aa1 Switch MASTER_SITE_PGSQL over to non-https URL. 2015-02-16 11:04:16 +00:00
jperkin
680762de01 Put back implementation of MASTER_SITE_OPENBSD. 2015-02-16 11:03:20 +00:00
mef
4bb927c596 As was proposed at pkgsrc-users@:
http://mail-index.netbsd.org/pkgsrc-users/2015/02/08/msg021031.html
Some sites not found DNS on records are deleted.
One hostname change included also.
  -	ftp://ftp.gtlib.cc.gatech.edu/pub/kde/stable/ \
  +	ftp://ftp.gtlib.gatech.edu/pub/kde/stable/ \
Thank you,
2015-02-10 05:29:59 +00:00
tnn
27878afe08 The SUNET archive is being decomissioned ( http://ftp.sunet.se/news.html ) 2015-02-07 22:49:31 +00:00
wiz
4c1455c79a Remove postgres mirror, none of them worked for me nor ftp.netbsd.org.
Add main postgres site.
2015-02-01 13:40:36 +00:00
obache
07f5a526c0 Revert "Define and use MASTER_SITE_OPENBSD.",
proposed/discussed is required for such changes.
2015-02-01 09:07:40 +00:00
obache
749343dca8 Define and use MASTER_SITE_OPENBSD. 2015-01-17 05:51:43 +00:00
rodent
d43c96209e Update MASTER_SITE_SUSE with paths that work. 2014-12-04 18:42:40 +00:00
tron
f193382d69 Pass "--remote-time" option to "curl" to get correct time stamps
on downloaded files.
2014-10-07 07:27:18 +00:00
obache
803b90aae3 rubyforge.org had been gone, removed.
Additionally, rubygems master site respond right redirect now, so back to
master URL.
2014-08-08 11:17:13 +00:00
wiz
6e4d3eab54 Improve previous. 2014-05-19 13:59:15 +00:00
obache
ebfc719a19 Note about mantainance of pkgsrc guide. 2014-05-19 13:52:33 +00:00
ryoon
34152738e1 Re-add iij mirror of sourceforge.jp, and re-corder mirror sites.
Thank you, Shuji SADO and obache@.
2014-05-08 11:11:15 +00:00
ryoon
a450329d04 Remove sourceforge.jp mirror sites that is not listed
in official download page.
They have no uptodate content, and download.sourceforge.jp is
redirect only.
2014-05-06 13:11:46 +00:00
ryoon
a05b45c990 Remove http://keihanna.dl.sourceforge.jp/ from sourceforge.jp mirror.
It is dead.
2014-05-06 12:53:31 +00:00