Greg Stein [Sat, 21 May 2022 07:38:14 +0000 (03:38 -0400)]
note required packages
cmake and g++ might not be on a bare/new install. Note they are required.
Andrew Wetmore [Thu, 5 May 2022 14:21:42 +0000 (11:21 -0300)]
Update pelicanconf.md
Andrew Wetmore [Thu, 5 May 2022 14:21:20 +0000 (11:21 -0300)]
Update pelicanconf.md
Text has moved to https://infra.apache.org/asf-pelican-config.html
Andrew Wetmore [Wed, 4 May 2022 12:22:54 +0000 (09:22 -0300)]
Update pelicanconf.md
minor text tweak.
dfoulks1 [Mon, 25 Apr 2022 17:55:23 +0000 (12:55 -0500)]
OF: Added more currently utilized plugins to pelican repo
Sebb [Sat, 16 Apr 2022 11:12:13 +0000 (12:12 +0100)]
Docco
Sebb [Sat, 16 Apr 2022 10:35:20 +0000 (11:35 +0100)]
Defer copying code to reduce rebuilds on changes
Sebb [Sat, 16 Apr 2022 10:28:54 +0000 (11:28 +0100)]
No longer needed
Daniel Gruno [Fri, 15 Apr 2022 16:17:07 +0000 (18:17 +0200)]
Merge pull request #28 from apache/gs-flexible
More flexible pelican config/run.
Daniel Gruno [Fri, 15 Apr 2022 14:27:01 +0000 (16:27 +0200)]
Merge pull request #30 from apache/humbedooh/eccn-remote-patch
Add support for remote fetching of ECCN yaml
Daniel Gruno [Fri, 15 Apr 2022 14:26:23 +0000 (16:26 +0200)]
start, not begin
Daniel Gruno [Fri, 15 Apr 2022 12:43:35 +0000 (14:43 +0200)]
Add support for remote fetching of ECCN yaml
Greg Stein [Wed, 6 Apr 2022 06:03:24 +0000 (01:03 -0500)]
More flexible pelican config/run.
The current buildsite.py process assumes the content is placed into
"content". This is fixed through a new CONTENT_DIR variable.
generate_settings() makes some assumptions about the location of the
theme and any plugins. Clarify this with SETTINGS_DIR variable.
For now, just hack in a look for a "site" directory, which we knows
contains all of the above. If a "content" directory is present, then
it is the original layout, and we keep on rollin'
Added some docco at the head to specify what is needed to run this
script in a local dev/test scenario.
Greg Stein [Mon, 4 Apr 2022 07:20:05 +0000 (02:20 -0500)]
Enable content options in the YAML.
For example
content:
content: name_of_subdir
static_dirs:
- css
- images
- js
Greg Stein [Mon, 4 Apr 2022 07:06:48 +0000 (02:06 -0500)]
Add a pair of new params for the "dir" subcommand.
Greg Stein [Mon, 4 Apr 2022 06:55:12 +0000 (01:55 -0500)]
Split out vars for different directories.
Greg Stein [Mon, 4 Apr 2022 06:38:07 +0000 (01:38 -0500)]
Revise offering help.
We don't allow for pelicanconf.py in the "dir" subcommand. So just
exit after pointing people to a web page. Don't spam the console.
Sebb [Sun, 21 Nov 2021 20:22:30 +0000 (20:22 +0000)]
Fix up to allow for python move
Daniel Gruno [Sat, 13 Nov 2021 01:56:26 +0000 (02:56 +0100)]
call py3 directly, avoid inheriting a broken environment
Sebb [Sun, 22 Aug 2021 15:00:32 +0000 (16:00 +0100)]
Ensure requirements.txt is up to date
Dave Fisher [Fri, 20 Aug 2021 20:13:20 +0000 (13:13 -0700)]
asfindex plugin for site index (#26)
* asfindex content generation
* Settings for asfindex plugin / scope on index
* Abandon Menu Generation
While index generation is generalizable menu generation is not.
Sebb [Wed, 21 Jul 2021 10:46:17 +0000 (11:46 +0100)]
OF: document condition
sebbASF [Wed, 21 Jul 2021 10:28:47 +0000 (11:28 +0100)]
Document script purpose
Sebb [Tue, 20 Jul 2021 22:03:34 +0000 (23:03 +0100)]
OF: unnecessary (and wrong)
The pelican command creates the output directory as necessary.
In any case, the default in buildsite.py is site-generated not /site-generated.
sebbASF [Tue, 20 Jul 2021 19:10:03 +0000 (20:10 +0100)]
Use requirements.txt (#22)
Dave Fisher [Tue, 20 Jul 2021 19:00:13 +0000 (12:00 -0700)]
OF: Cleanup Dockerfile installs - add DOCKER.md (#20)
* OF: Cleanup Dockerfile installs - add DOCKER.md
* Update DOCKER.md
sebbASF [Mon, 19 Jul 2021 15:09:20 +0000 (16:09 +0100)]
OF: Avoid: --bind without --listen has no effect (#18)
Does not impact buildbot
sebbASF [Mon, 19 Jul 2021 10:31:52 +0000 (11:31 +0100)]
Merge pull request #16 from apache/dave/smaller-docker-image
Two stage Dockerfile saves 230MB in image
Dave Fisher [Sun, 18 Jul 2021 15:56:37 +0000 (08:56 -0700)]
Two phase Dockerfile saves 230MB in image
sebbASF [Sun, 18 Jul 2021 15:25:22 +0000 (16:25 +0100)]
Simplify docker; build from checkout (#15)
* Simplify docker; build from checkout
* Avoid File not found error
* Need to include a file that is displayed if pelicanconf.yaml is missing
* Adding .authtokens to image
* Revert "Adding .authtokens to image"
This reverts commit
b760ff708eb6cd1cde3262c2e71b6cb6fb96036f.
* Don't hide missing authtokens
* Get authtokens from site checkout
Co-authored-by: Dave Fisher <dave@davefisher.tech>
Dave Fisher [Fri, 16 Jul 2021 17:02:02 +0000 (10:02 -0700)]
OF: Dockerfile - use recent commit hash, support all buildsite.py, more examples (#13)
* Add subversion and git to Dockerfile, use latest commit hash
* Add additional comments with instructions
Greg Stein [Fri, 16 Jul 2021 07:19:52 +0000 (02:19 -0500)]
Merge pull request #11 from bdelacretaz/dockerfile/plugins-commit-hash
Mention INFRA_PELICAN_COMMIT in Dockerfile build instructions
Bertrand Delacretaz [Fri, 16 Jul 2021 07:17:10 +0000 (09:17 +0200)]
typo
Bertrand Delacretaz [Fri, 16 Jul 2021 07:12:39 +0000 (09:12 +0200)]
Mention INFRA_PELICAN_COMMIT in build instructions
Greg Stein [Thu, 15 Jul 2021 23:28:28 +0000 (18:28 -0500)]
Merge pull request #10 from apache/sebb/pylint
Fix an escaped period. Remove unused import. Use 4-space indents.
Sebb [Thu, 15 Jul 2021 22:55:13 +0000 (23:55 +0100)]
Pylint fixes
Sebb [Thu, 15 Jul 2021 22:43:53 +0000 (23:43 +0100)]
TODO
Sebb [Thu, 15 Jul 2021 22:18:17 +0000 (23:18 +0100)]
OF: fix file name
sebbASF [Thu, 15 Jul 2021 21:20:42 +0000 (22:20 +0100)]
Plugin is very noisy (#5)
Dave Fisher [Thu, 15 Jul 2021 20:37:16 +0000 (13:37 -0700)]
OF: update plugin architecture
Greg Stein [Thu, 15 Jul 2021 20:10:17 +0000 (15:10 -0500)]
Merge pull request #4 from apache/dave/anomolous-backslash
The `\\.` form is clearer, even two the single slash form works in Python.
Greg Stein [Thu, 15 Jul 2021 19:45:52 +0000 (14:45 -0500)]
OF: remove required= argument (not available in py3.6)
Greg Stein [Thu, 15 Jul 2021 19:33:26 +0000 (14:33 -0500)]
Merge pull request #9 from apache/feature/Dockerfile
adds a Dockerfile, creates subcommands for buildsite.py, makes plugin yaml optional/defaulted, and adds some doc for configuring the pelican build via yaml
Dave Fisher [Thu, 15 Jul 2021 19:14:06 +0000 (12:14 -0700)]
Update commit in Dockerfile
Dave Fisher [Thu, 15 Jul 2021 19:09:59 +0000 (12:09 -0700)]
Adjust args parsing - include args.func(args)
Dave Fisher [Thu, 15 Jul 2021 17:37:30 +0000 (10:37 -0700)]
Dockerfile with commit hash updated
Dave Fisher [Thu, 15 Jul 2021 17:33:18 +0000 (10:33 -0700)]
add initial help about pelicanconf.yaml
Dave Fisher [Thu, 15 Jul 2021 16:57:47 +0000 (09:57 -0700)]
buildsite.py now has two commands: git and dir
Greg Stein [Wed, 14 Jul 2021 22:58:43 +0000 (17:58 -0500)]
Merge pull request #8 from apache/feature/allow-empty-plugins
Feature/allow empty plugins
Dave Fisher [Wed, 14 Jul 2021 22:19:45 +0000 (15:19 -0700)]
OF: Add all plugins to the README (#7)
* Add all plugins to the README
* Update README.md
* Add pelican architecture notes
Dave Fisher [Wed, 14 Jul 2021 21:54:06 +0000 (14:54 -0700)]
Update gitignore for cmark library installed in place
Dave Fisher [Wed, 14 Jul 2021 21:29:11 +0000 (14:29 -0700)]
Set checkout to commit point which has build_in_docker.py
Dave Fisher [Wed, 14 Jul 2021 21:18:07 +0000 (14:18 -0700)]
Introduce Dockerfile
Dave Fisher [Wed, 14 Jul 2021 17:28:32 +0000 (10:28 -0700)]
Fix plugins specification
Dave Fisher [Wed, 14 Jul 2021 17:17:05 +0000 (10:17 -0700)]
Allow missing plugins directive along with missing path and use
Dave Fisher [Tue, 13 Jul 2021 14:51:23 +0000 (07:51 -0700)]
Fixup [ and ] for ezt in download templates
Dave Fisher [Mon, 5 Jul 2021 15:46:44 +0000 (08:46 -0700)]
Per sebb - fix anomolous backslash
Sebb [Mon, 5 Jul 2021 00:02:20 +0000 (01:02 +0100)]
OF: unused import
Greg Stein [Sun, 4 Jul 2021 20:59:25 +0000 (15:59 -0500)]
Merge pull request #3 from apache/dave/no-single-branch
clone with --depth=1 --no-single-branch
Dave Fisher [Sun, 4 Jul 2021 18:11:10 +0000 (11:11 -0700)]
clone with --depth=1 --no-single-branch
Greg Stein [Sat, 3 Jul 2021 21:46:06 +0000 (16:46 -0500)]
Merge pull request #1 from apache/dave/expanded
Add more yaml config for asfdata, asfrun, and asfcopy plugins. Update asfgenid. Debug buildsite.py
Greg Stein [Sat, 3 Jul 2021 21:45:01 +0000 (16:45 -0500)]
Some tweaks to generate_settings()
Greg Stein [Sat, 3 Jul 2021 21:38:31 +0000 (16:38 -0500)]
Minor edits
Dave Fisher [Sat, 3 Jul 2021 19:52:06 +0000 (12:52 -0700)]
update to asfgenid
Dave Fisher [Sat, 3 Jul 2021 19:26:20 +0000 (12:26 -0700)]
remove extra data
Dave Fisher [Sat, 3 Jul 2021 19:22:04 +0000 (12:22 -0700)]
top level debug in yaml
Dave Fisher [Sat, 3 Jul 2021 18:54:18 +0000 (11:54 -0700)]
code review
Dave Fisher [Sat, 3 Jul 2021 16:52:47 +0000 (09:52 -0700)]
Add asfdata, asfrun, and asfcopy plugins. Update asfgenid. Debug.
Dave Fisher [Fri, 2 Jul 2021 18:32:52 +0000 (11:32 -0700)]
dev/test improvements: --listen mode and requirements.txt not processed msg
Greg Stein [Thu, 1 Jul 2021 20:51:48 +0000 (15:51 -0500)]
use --quiet rather than printing diffs. implies --exit-code
Greg Stein [Thu, 1 Jul 2021 20:36:29 +0000 (15:36 -0500)]
fix path to the builtin plugins
Greg Stein [Thu, 1 Jul 2021 20:32:23 +0000 (15:32 -0500)]
Avoid committing, if no changes. Do more work in dev/test environ, but do not push.
Dave Fisher [Thu, 1 Jul 2021 19:13:49 +0000 (12:13 -0700)]
Set PAGE_TRANSLATION_ID = None and TIMEZONE = 'UTC'
Greg Stein [Mon, 28 Jun 2021 04:48:31 +0000 (23:48 -0500)]
simple script to build/compare pelican builds
Greg Stein [Sat, 26 Jun 2021 05:31:41 +0000 (00:31 -0500)]
Improve the template for auto-settings.
* include the THEME
* ezt sees [alpha ... so use whitespace after [ rather than [[]
* specify PAGE_PATHS and STATIC_PATHS
* use the {path_no_ext} pattern, as the default
- future: deal with subdirs for the pages (eg. petri)
* disable Articles
* disable processing of .html files
Greg Stein [Sat, 26 Jun 2021 05:22:02 +0000 (00:22 -0500)]
Theme should be in the conf, not cmdline.
- remove the --theme arg from buildsite.py
- pelicanconf.py can specify THEME
- pelicanconf.yaml can specify theme:
(the .ezt mapping the theme is a future commit)
Greg Stein [Sat, 26 Jun 2021 00:04:57 +0000 (19:04 -0500)]
Remove duplicate debug genid param.
Greg Stein [Fri, 25 Jun 2021 20:27:49 +0000 (15:27 -0500)]
Tweaks to the auto-settings.
* add default of False for the boolean options, if they are
not specified
* add the "debug" genid option
Greg Stein [Thu, 24 Jun 2021 05:56:09 +0000 (00:56 -0500)]
Tweak the regex for headers
Greg Stein [Thu, 24 Jun 2021 05:30:43 +0000 (00:30 -0500)]
Use the GFMReader's new module name.
Greg Stein [Thu, 24 Jun 2021 05:18:59 +0000 (00:18 -0500)]
Add the plugin, if the yaml configures it.
Greg Stein [Thu, 24 Jun 2021 05:13:27 +0000 (00:13 -0500)]
Add YAML config for the asfgenid plugin.
If the 'genid' section is present in the yaml, then configure
ASF_GENID within the auto settings.
Greg Stein [Tue, 22 Jun 2021 07:52:24 +0000 (02:52 -0500)]
Comment tweak for using grab.sh
Greg Stein [Tue, 22 Jun 2021 07:35:46 +0000 (02:35 -0500)]
Move gfm.py to plugins/
Greg Stein [Tue, 22 Jun 2021 07:26:12 +0000 (02:26 -0500)]
Enable Pelican builds using YAML config.
Rather than an arbitrary .py config/settings input file, we move the
"standard ASF settings" into a .yaml file. The YAML input is passed
through an EZT template to automatically produce a .py file to be
passed into Pelican.
* pelican.auto.ezt: new template for the auto-settings
* buildsite.py:
- tweak imports
- (AUTO_SETTINGS*): specify the various auto-settings filenames
- conditionally load requirements.txt, based on IS_PRODUCTION
- no longer copy plugins around, as we'll be smarter with PLUGIN_PATHS
- if "pelicanconf.yaml" exists, then generate a settings file from
the contents of the .yaml
- if no such .yaml, then assume a class "pelicanconf.py" and append
some PLUGINS into that file. Undesireable, but good for a stopgap.
- when invoking Pelican, pass the (maybe-auto) settings file
- new generate_settings() to map a .yaml to a .py using the template
Dave Fisher [Wed, 16 Jun 2021 15:48:40 +0000 (08:48 -0700)]
Merge branch 'master' of https://github.com/apache/infrastructure-pelican
Dave Fisher [Wed, 16 Jun 2021 15:45:37 +0000 (08:45 -0700)]
put things back
Gav [Wed, 16 Jun 2021 15:19:08 +0000 (17:19 +0200)]
specify path
Gav [Wed, 16 Jun 2021 12:54:15 +0000 (14:54 +0200)]
change path
Sebb [Wed, 16 Jun 2021 12:22:27 +0000 (13:22 +0100)]
OF: typo
Dave Fisher [Wed, 16 Jun 2021 12:14:00 +0000 (05:14 -0700)]
Move pelican-gfm into plugins
sebbASF [Wed, 16 Jun 2021 11:53:31 +0000 (12:53 +0100)]
Update README.md
Greg Stein [Mon, 14 Jun 2021 21:08:34 +0000 (16:08 -0500)]
ignore __pycache__
Greg Stein [Mon, 14 Jun 2021 21:08:21 +0000 (16:08 -0500)]
Merge branch 'master' of https://github.com/apache/infrastructure-pelican
Greg Stein [Mon, 14 Jun 2021 21:08:08 +0000 (16:08 -0500)]
add ALv2 license
Greg Stein [Mon, 14 Jun 2021 21:03:58 +0000 (16:03 -0500)]
Create README.md
Describe the available/standard plugins
Greg Stein [Mon, 14 Jun 2021 20:59:21 +0000 (15:59 -0500)]
Create requirements.txt
Used by `bin/kick_build.py`
Greg Stein [Mon, 14 Jun 2021 13:14:43 +0000 (08:14 -0500)]
Update README.md
Provide example usage of kick_build.py
Greg Stein [Mon, 14 Jun 2021 13:10:19 +0000 (08:10 -0500)]
Quick script to kick off a site rebuild.
Greg Stein [Thu, 10 Jun 2021 07:12:39 +0000 (02:12 -0500)]
Update README.md