| Index | index by Group | index by Distribution | index by Vendor | index by creation date | index by Name | Mirrors | Help | Search |
| Name: mirrormanager2-crawler | Distribution: Fedora Project |
| Version: 0.11 | Vendor: Fedora Project |
| Release: 1.el7 | Build date: Fri Oct 4 22:21:06 2019 |
| Group: Unspecified | Build host: buildvm-14.phx2.fedoraproject.org |
| Size: 55832 | Source RPM: mirrormanager2-0.11-1.el7.src.rpm |
| Packager: Fedora Project | |
| Url: https://github.com/fedora-infra/mirrormanager2/ | |
| Summary: Crawler for MirrorManager | |
Install the crawler for MirrorManager, crawling all the mirrors to find out if they are up to date or not
MIT and GPLv2+ and GPLv2
* Fri Oct 04 2019 Adrian Reber <adrian@lisas.de> - 0.11-1
- Update to 0.11
- Offer protobuf output in refresh mirrorlist cache script
* Thu Oct 03 2019 Adrian Reber <adrian@lisas.de> - 0.10-1
- Update to 0.10
- crawler: correctly auto-disable mirrors
https://github.com/fedora-infra/mirrormanager2/pull/265
- Use protobuf instead of pickle for backend - mirrorlist data exchange
https://github.com/fedora-infra/mirrormanager2/pull/266
- Fix report_mirror with python3
https://github.com/fedora-infra/mirrormanager2/pull/269
- repomap: add playground support
https://github.com/fedora-infra/mirrormanager2/pull/270
* Thu Oct 03 2019 Miro Hrončok <mhroncok@redhat.com> - 0.9.0-6
- Rebuilt for Python 3.8.0rc1 (#1748018)
* Mon Aug 19 2019 Miro Hrončok <mhroncok@redhat.com> - 0.9.0-5
- Rebuilt for Python 3.8
* Thu Jul 25 2019 Fedora Release Engineering <releng@fedoraproject.org> - 0.9.0-4
- Rebuilt for https://fedoraproject.org/wiki/Fedora_31_Mass_Rebuild
* Tue May 07 2019 Jason L Tibbitts III <tibbs@math.uh.edu> - 0.9.0-3
- Patch requirements.txt to avoid an autogenerated dependency on
python3.7dist(python-openid) which cannot be satisfied. Fixes
https://bugzilla.redhat.com/show_bug.cgi?id=1707550
* Fri Feb 01 2019 Fedora Release Engineering <releng@fedoraproject.org> - 0.9.0-2
- Rebuilt for https://fedoraproject.org/wiki/Fedora_30_Mass_Rebuild
* Tue Jan 15 2019 Adrian Reber <adrian@lisas.de> - 0.9.0-1
- Update to 0.9.0
- crawler: Correctly calculate the remaining time
https://github.com/fedora-infra/mirrormanager2/pull/244
- repomap: more modular repository detection logic
https://github.com/fedora-infra/mirrormanager2/pull/243
- crawler: correctly handle keep-alive for HTTPS
https://github.com/fedora-infra/mirrormanager2/pull/245
- crawler: only update directories of the current category
https://github.com/fedora-infra/mirrormanager2/pull/250
- python3 compatibility
https://github.com/fedora-infra/mirrormanager2/pull/185
- rpmmd: switch from yum.repoMDObject pyrpmmd
https://github.com/fedora-infra/mirrormanager2/pull/254
- Migrate to new geoip API
https://github.com/fedora-infra/mirrormanager2/pull/253
- Use InputRequired() instead of Required()
https://github.com/fedora-infra/mirrormanager2/pull/256
- Enable MirrorManager2 to be built using Python 3 for Fedora
https://github.com/fedora-infra/mirrormanager2/pull/260
- Fix tests with python3
https://github.com/fedora-infra/mirrormanager2/pull/261
- Toggle private
https://github.com/fedora-infra/mirrormanager2/pull/257
* Sun Jul 22 2018 Adrian Reber <adrian@lisas.de> - 0.8.4-4
- Disable tests requiring network access
* Fri Jul 13 2018 Fedora Release Engineering <releng@fedoraproject.org> - 0.8.4-3
- Rebuilt for https://fedoraproject.org/wiki/Fedora_29_Mass_Rebuild
* Sun Mar 04 2018 Adrian Reber <adrian@lisas.de> - 0.8.4-2
- Handle mod_wsgi on Fedora 27 requirement
* Sun Mar 04 2018 Adrian Reber <adrian@lisas.de> - 0.8.4-1
- Update to 0.8.4
- Sync with Fedora's specfile
- Explicitly specify 'python2' wherever calling the python
interpreter
- Correctly handle Fedora 28 modular layout
https://github.com/fedora-infra/mirrormanager2/pull/242
- Use "site", "host" and "mirror" consistently
https://github.com/fedora-infra/mirrormanager2/pull/241
- crawler: support https only hosts
https://github.com/fedora-infra/mirrormanager2/pull/240
- Make mm2_get_internet2_netblocks work again
https://github.com/fedora-infra/mirrormanager2/pull/234
- crawler: use timeout also on rsync crawls
https://github.com/fedora-infra/mirrormanager2/pull/229
- Fix existing test cases and re-enable tests on commits
- Enable tests in the %check section
- publiclist: hide disabled arches and products
https://github.com/fedora-infra/mirrormanager2/pull/223
* Thu Mar 01 2018 Iryna Shcherbina <ishcherb@redhat.com> - 0.8.3-3
- Update Python 2 dependency declarations to new packaging standards
(See https://fedoraproject.org/wiki/FinalizingFedoraSwitchtoPython3)
* Thu Feb 08 2018 Fedora Release Engineering <releng@fedoraproject.org> - 0.8.3-2
- Rebuilt for https://fedoraproject.org/wiki/Fedora_28_Mass_Rebuild
* Tue Sep 26 2017 Adrian Reber <adrian@lisas.de> - 0.8.3-1
- Update to 0.8.3
- umdl: fix 'modular' repository detection
https://github.com/fedora-infra/mirrormanager2/pull/221
* Sun Sep 24 2017 Adrian Reber <adrian@lisas.de> - 0.8.2-1
- Update to 0.8.2
- detect and setup mirrorlist/metalinks for modular Fedora
https://github.com/fedora-infra/mirrormanager2/pull/220
- umdl: only create repositories for 'Everything'
https://github.com/fedora-infra/mirrormanager2/pull/219
- Correctly detect repositories
https://github.com/fedora-infra/mirrormanager2/pull/218
* Sun Aug 27 2017 Adrian Reber <adrian@lisas.de> - 0.8.1-2
- handle python-basemap -> python2-basemap rename
* Mon Aug 07 2017 Adrian Reber <adrian@lisas.de> - 0.8.1-1
- Update to 0.8.1
- Revert namespace changes
https://github.com/fedora-infra/mirrormanager2/pull/214
- move-devel-to-release: fix the script to work with f26
https://github.com/fedora-infra/mirrormanager2/pull/213
- Initial conversion to Fedora Bootstrap
https://github.com/fedora-infra/mirrormanager2/pull/204
- umdl: various fixes found in production
https://github.com/fedora-infra/mirrormanager2/pull/211
* Wed Jul 26 2017 Fedora Release Engineering <releng@fedoraproject.org> - 0.8-2
- Rebuilt for https://fedoraproject.org/wiki/Fedora_27_Mass_Rebuild
* Fri Jun 02 2017 Adrian Reber <adrian@lisas.de> - 0.8-1
- Update to 0.8
- Specify rel="noopener noreferrer" to link including target='_blank'
- Improve the runserver script
- Make the propagation script more robust
- crawler: also crawl https-only mirrors
https://github.com/fedora-infra/mirrormanager2/issues/183
- mm2_move-devel-to-release: adapt to latest repository layout
https://github.com/fedora-infra/mirrormanager2/issues/195
- Private URLs are now restricted to admins
https://github.com/fedora-infra/mirrormanager2/issues/149
- mirrorlist: at least 5 mirrors should be returned for country/continent
https://github.com/fedora-infra/mirrormanager2/issues/194
- Remove 'Master rsync server Access Control List IPs' section
https://github.com/fedora-infra/mirrormanager2/issues/145
- mirrorlist: add pkl generation time to pkl
https://github.com/fedora-infra/mirrormanager2/issues/184
- restrict non-admin users to certain netblock sizes
https://github.com/fedora-infra/mirrormanager2/issues/71
- Change all references from fedorahosted.org to use the github area
- umdl: add fullfiletimelist-* based master scanning
https://github.com/fedora-infra/mirrormanager2/issues/206
* Fri Feb 10 2017 Fedora Release Engineering <releng@fedoraproject.org> - 0.7.3-5
- Rebuilt for https://fedoraproject.org/wiki/Fedora_26_Mass_Rebuild
* Tue Oct 11 2016 Patrick Uiterwijk <puiterwijk@redhat.com> - 0.7.3-4
- Obsolete and provide mirrormanager-client
* Mon Oct 10 2016 Patrick Uiterwijk <puiterwijk@redhat.com> - 0.7.3-3
- Changed everything to buildroot
- Added dependencies for needed directories
- Added filesystem subpackage to own the directories
- Added license macro to license files
* Sat Oct 08 2016 Patrick Uiterwijk <puiterwijk@redhat.com> - 0.7.3-2
- Remove <0.80 requirement from IPy
- Moved back from systemd-devel to systemd dependency
- Removed RHEL6 conditionals
- Use py2_install and py2_build
- Fixed lib dependency
- Updated URL and Source
* Thu Jun 23 2016 Adrian Reber <adrian@lisas.de> - 0.7.3-1
- Update to 0.7.3
- Allow submission of checkin information via json (Patrick Uiterwijk)
https://github.com/fedora-infra/mirrormanager2/issues/170
- Add logging to checkin code (Patrick Uiterwijk)
- mm2_crawler: Add missing field to stats dict
https://github.com/fedora-infra/mirrormanager2/issues/176
- mirrolist: fix &redirect=1
https://github.com/fedora-infra/mirrormanager2/issues/178
* Wed Jun 15 2016 Adrian Reber <adrian@lisas.de> - 0.7.2-1
- Update to 0.7.2
- Fix propagation diagram creation
- Use yesterday's date in get_global_netblocks
- Mark path containing /stage/ as testing
- Added an option with which the user can define the preferred
protocol)
- Adjust repomap for the new repo layout (Pierre-Yves Chibon)
- Typo fix in readme (Taranjeet)
* Mon Feb 01 2016 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.7.1-1
- Update to 0.7.1
- Fixes to the emergency script (Adrian Reber and Patrick Uiterwijk)
* Wed Jan 13 2016 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.7-1
- Update to 0.7
- Fix various matplotlib problems in the statitics (Adrian Reber)
- Make green be synced and red be older in the propagation page (Patrick
Uiterwijk)
- Add the possibility to clear all old files from a repo (to ensure users have
only up to date mirrors) (Patrick Uiterwijk)
- Do not load the host config until it's asked (Drops the memory usage and
increase the speed of the application) (Adrian Reber)
* Thu Dec 17 2015 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.6.1-1
- Update to 0.6.1
- Fix mirrorlist to access info from the just loaded pickle (Patrick Uiterwijk)
* Wed Dec 16 2015 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.6-1
- Update to 0.6
- Really ensure that new host is admin_active (Seth Jennings)
- Add the possibility to kill rsync after some time
- Add headers to the table listing the mirrors
- Cascade deletion and bring back the rsyncFilter endpoint
- Fix to the crawler (Adrian Reber)
- Improved documentation and validation
- Optionally exclude certain protocols from MM (Adrian Reber)
- Import generate-worldmap from MM1 (Adrian Reber)
- Optionally display mirrorlist statistics (Adrian Reber)
- mirrorlist: Remove --debug option (Adrian Reber)
- More mirrorlist statistics changes and spec file integration (Adrian Reber)
- Switch the MirrorList server to use threading rather than forking (Patrick
Uiterwijk)
* Mon Sep 07 2015 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.5.1-1
- Update to 0.5.1
- Deleting URLs if site or host is removed (avoids the situation where a host is
removed and then someone tries to re-add it) (Adrian Reber)
- Ensure that new host and new site are admin_active
* Fri Sep 04 2015 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.5-1
- Update to 0.5
- Add order option to get_file_detail() (Adrian Reber)
- Remove all whitespaces around the mirror URLs (Adrian Reber)
- Sort metalinks alternates by timestamps descending (Adrian Reber)
- Rewrite the UMDL2 into a UMDL2
- Add code to graph repomd.xml propagation (Adrian Reber)
- Rotate crawler logs once per week (Adrian Reber)
- Update the UMDL1 to share code with the UMDL2 (Adrian Reber)
- Remove trailing slash of site and host_category_url
* Thu Jul 30 2015 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.4.2-1
- Update to 0.4.2
- Create the -client subpackage containing the report_mirror script and
configuration file (Adrian Reber)
* Tue Jul 28 2015 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.4.1-1
- Update to 0.4.1
- If the host has no categories do not auto-disable it (Adrian Reber)
- Different small umdl and crawler fixe (Adrian Reber)
* Wed Jul 22 2015 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.4.0-1
- Update to 0.4.0
- Add utility script to update the MM2 DB for a single file (light-weight UMDL
for a single file) (Ralph Bean)
- Add support to gracefully shutdown the crawler (Adrian Reber)
- Add support to limit crawling by continent (Adrian Reber)
- Fix the crawler to work properly with MM2
- Fix the repomap to create properly development repos
- Fix new repository detection and creation in UMDL (Adrian Reber)
* Thu Jul 02 2015 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.3.1-1
- Update to 0.3.1
- Fix for broken logging output in the UMDL (Adrian Reber)
- Fix mm2_move-to-archive (Adrian Reber)
* Wed Jun 24 2015 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.3.0-1
- Update to 0.3.0
- Fix the --delete action of the umdl (Adrian Reber)
- If the user is not an admin, keep the existing admin_active settings
- Only MM2 admins are allowed to change the always_up2date flag of a mirror
- Also fix the mm2_crawler logrotate script like the one for umdl (Adrian Reber)
* Thu Jun 11 2015 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.2.1-1
- Update to 0.2.1
- Fix the mm2_move-devel-to-release script to work properly with MM2 and our
products (Adrian Reber)
* Fri Jun 05 2015 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.2.0-1
- Update to 0.2.0
- Include the background header file in MM2 itself (Adrian Reber)
- Support always update hosts which are unreachable in the crawler (Adrian
Reber)
- Adjust the spec file to the systemd packaging guidelines for Fedora
- Multiple improvements to the crawler, including a start of a canary mode
(Adrian Reber)
- Offer possibility to sort by product, bringing back MM1 behavior (Adrian
Reber)
- Couple of UI fixes about who is allowed to access what
- Fix peer ASNs (in the same spirit, who can access)
- Create noauthed master for mirror publiclist so that it can be cached in
memcachd (Patrick Uiterwijk)
- Fix the report_mirror to correctly catch the xmlrpclib.ProtocolError
- Add a new utility script to upgrade repo from -alpha or -beta to release
- Adjust the logrotate configuration to fix the permission denied error
- Create 2 API endpoints, one for zodbot's .mirroradmin and one for nagios
* Thu May 07 2015 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.1.0-1
- Update 0.1.0
- Add the possibilities to delete a site or a host
- Do not only create /var/lock/mirrormanager on installation (Adrian Reber)
* Tue May 05 2015 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.0.10-1
- Update to 0.0.10
- Install the mm2_create_install_repo script
- Fix version handling on mm2_create_install_repo (Adrian Reber)
- Fix pickle generation when several repositories point to the same directory
* Mon May 04 2015 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.0.9-1
- Update to 0.0.9
- Include and install alembic files
- Try explicit garbage collection in the crawler (Adrian Reber)
- Use defined timeout also for HTTP/FTP connections (Adrian Reber)
- Add documentation about the crawler (Adrian Reber)
- Also add a /var/run directory for the backend (Adrian Reber)
- Add fedmenu integration
- Add new utility script to be used to create the fedora-install-X repositories
- Added last-sync script as mm2_last-sync (Adrian Reber)
* Thu Apr 23 2015 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.0.8-1
- Update to 0.0.8
- Make MM2 a little prettier on high-res display
- Add a Location tag for static (Patrick Uiterwijk)
- Fix the DB session issue on the crawler (Adrian Reber)
- Add some documentation on how MirrorManager works
- Decrease time required for set_not_up2date() (Adrien Reber)
- Add support to auto disable mirrors (Adrien Reber)
- Auto disable hosts which have a URL configured but which does not exist
(Adrian Reber)
- crawl_duration is a host specific property (Adrian Reber)
- Handle lighttpd returing a content length for directories (Adrian Reber)
- Scan the directories which are supposed to be on each mirror (Adrian Reber)
- Use Yesterday's date on mm2_get_internet2_netblocks to avoid TZ issue (Adrian
Reber)
- Fix logging in the UMDL script (Adrian Reber)
- Allow the UMDL to crawl only a specified category (Adrian Reber)
- Fix example fedmsg config (Ralph Bean)
* Mon Apr 13 2015 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.0.7-1
- Update to 0.0.7
- Add missing import on mm2_update-EC2-netblocks
- Have the cron jobs running under a ``mirrormanager`` user (Adrian Reber)
- Update the last_crawled and last_crawled_duration correctly (Adrian Reber)
- Fix systemd's tempfile.conf for mirrormanager2
- Fix link to the crawler log file (Adrian Reber)
- Close per thread logging correctly (Adrian Reber)
- Add more informations to the log output (Adrian Reber)
- Start crawling the hosts which require the most time (Adrian Reber)
- Filters the hosts to crawl at the DB level to save time and memory (Adrian
Reber)
- Fix the xmlrpc endpoint (Adrian Reber)
- Adjust Build Requires to include systemd-devel instead of just systemd
- Close session at the end and make the session permanent
- Add new columns to the host table to store extra infos (Adrian Reber)
- Use urllib2 instead of urlgrabber in the crawler (Adrian Reber)
- Fix crawler timeout (Adrian Reber)
- run_rsync() returns a temporary file which needs to be closed (Adrian Reber)
* Wed Mar 18 2015 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.0.6-1
- Update to 0.0.6
- Drop the Locations in the hosts (no longer used)
- Add unit-tests
- To the frontend
- To some of the backend scripts
- Add dependency to python-IPy
- Fix ExecStart instruction for systemd
- Fix apache configuration file for mirrorlist
- Fix host selection logic in the crawler (Adrian Reber)
- Log the rsync command (Adrian Reber)
- Add the possibility to specify the rsync argument via the configuration file
(Adrian Reber)
- Add and install a tempfile.d file for systemd to re-create
/var/run/mirrormanager upon reboot
* Mon Dec 15 2014 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.0.5-1
- Update to 0.0.5
- Include zebra-dump-parser in the backend sub-package
- Install weighted_shuffle and include it in the mirrorlist sub-package
* Mon Dec 15 2014 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.0.4-1
- Update to 0.0.4
- Fix typos in the script to point them to the correct configuration file by
default
- Install the mirrorlist_server
- Move mirrorlist to rely on systemd instead of supervisor
- Install zebra-dump-parser user by mm2_get_internet2_netblocks
- Remove debugging statement for mm2_refresh_mirrorlist_cache, no need to output
something if everything ran fine
* Mon Dec 08 2014 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.0.3-1
- Update to 0.0.3
- Fix the import in the createdb script
* Mon Dec 08 2014 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.0.2-1
- Update to 0.0.2
- Move the flask application to mirrormanager2/app.py and put a module
place holder in mirrormanager2/__init__.py that we can extract when
splitting the module in -lib
* Mon Dec 08 2014 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.0.1-2
- Fix the package name in the Requires, using %{name} fixes things
* Mon Dec 08 2014 Pierre-Yves Chibon <pingou@pingoured.fr> - 0.0.1-1
- Initial packaging work for Fedora
/etc/logrotate.d/mm2_crawler /usr/bin/mm2_crawler /var/lib/mirrormanager /var/log/mirrormanager /var/log/mirrormanager/crawler
Generated by rpm2html 1.8.1
Fabrice Bellet, Tue Jul 9 13:33:21 2024