infrastructure-pelican.git
8 hours agonote required packages master
Greg Stein [Sat, 21 May 2022 07:38:14 +0000 (03:38 -0400)] 
note required packages

cmake and g++ might not be on a bare/new install. Note they are required.

2 weeks agoUpdate pelicanconf.md
Andrew Wetmore [Thu, 5 May 2022 14:21:42 +0000 (11:21 -0300)] 
Update pelicanconf.md

2 weeks agoUpdate pelicanconf.md
Andrew Wetmore [Thu, 5 May 2022 14:21:20 +0000 (11:21 -0300)] 
Update pelicanconf.md

Text has moved to https://infra.apache.org/asf-pelican-config.html

2 weeks agoUpdate pelicanconf.md
Andrew Wetmore [Wed, 4 May 2022 12:22:54 +0000 (09:22 -0300)] 
Update pelicanconf.md

minor text tweak.

3 weeks agoOF: Added more currently utilized plugins to pelican repo
dfoulks1 [Mon, 25 Apr 2022 17:55:23 +0000 (12:55 -0500)] 
OF: Added more currently utilized plugins to pelican repo

5 weeks agoDocco
Sebb [Sat, 16 Apr 2022 11:12:13 +0000 (12:12 +0100)] 
Docco

5 weeks agoDefer copying code to reduce rebuilds on changes
Sebb [Sat, 16 Apr 2022 10:35:20 +0000 (11:35 +0100)] 
Defer copying code to reduce rebuilds on changes

5 weeks agoNo longer needed
Sebb [Sat, 16 Apr 2022 10:28:54 +0000 (11:28 +0100)] 
No longer needed

5 weeks agoMerge pull request #28 from apache/gs-flexible
Daniel Gruno [Fri, 15 Apr 2022 16:17:07 +0000 (18:17 +0200)] 
Merge pull request #28 from apache/gs-flexible

More flexible pelican config/run.

5 weeks agoMerge pull request #30 from apache/humbedooh/eccn-remote-patch
Daniel Gruno [Fri, 15 Apr 2022 14:27:01 +0000 (16:27 +0200)] 
Merge pull request #30 from apache/humbedooh/eccn-remote-patch

Add support for remote fetching of ECCN yaml

5 weeks agostart, not begin humbedooh/eccn-remote-patch 30/head
Daniel Gruno [Fri, 15 Apr 2022 14:26:23 +0000 (16:26 +0200)] 
start, not begin

5 weeks agoAdd support for remote fetching of ECCN yaml
Daniel Gruno [Fri, 15 Apr 2022 12:43:35 +0000 (14:43 +0200)] 
Add support for remote fetching of ECCN yaml

6 weeks agoMore flexible pelican config/run. gs-flexible 28/head
Greg Stein [Wed, 6 Apr 2022 06:03:24 +0000 (01:03 -0500)] 
More flexible pelican config/run.

The current buildsite.py process assumes the content is placed into
"content". This is fixed through a new CONTENT_DIR variable.

generate_settings() makes some assumptions about the location of the
theme and any plugins. Clarify this with SETTINGS_DIR variable.

For now, just hack in a look for a "site" directory, which we knows
contains all of the above. If a "content" directory is present, then
it is the original layout, and we keep on rollin'

Added some docco at the head to specify what is needed to run this
script in a local dev/test scenario.

6 weeks agoEnable content options in the YAML.
Greg Stein [Mon, 4 Apr 2022 07:20:05 +0000 (02:20 -0500)] 
Enable content options in the YAML.

For example

content:
  content: name_of_subdir
  static_dirs:
    - css
    - images
    - js

6 weeks agoAdd a pair of new params for the "dir" subcommand.
Greg Stein [Mon, 4 Apr 2022 07:06:48 +0000 (02:06 -0500)] 
Add a pair of new params for the "dir" subcommand.

6 weeks agoSplit out vars for different directories.
Greg Stein [Mon, 4 Apr 2022 06:55:12 +0000 (01:55 -0500)] 
Split out vars for different directories.

6 weeks agoRevise offering help.
Greg Stein [Mon, 4 Apr 2022 06:38:07 +0000 (01:38 -0500)] 
Revise offering help.

We don't allow for pelicanconf.py in the "dir" subcommand. So just
exit after pointing people to a web page. Don't spam the console.

5 months agoFix up to allow for python move
Sebb [Sun, 21 Nov 2021 20:22:30 +0000 (20:22 +0000)] 
Fix up to allow for python move

6 months agocall py3 directly, avoid inheriting a broken environment
Daniel Gruno [Sat, 13 Nov 2021 01:56:26 +0000 (02:56 +0100)] 
call py3 directly, avoid inheriting a broken environment

8 months agoEnsure requirements.txt is up to date
Sebb [Sun, 22 Aug 2021 15:00:32 +0000 (16:00 +0100)] 
Ensure requirements.txt is up to date

9 months agoasfindex plugin for site index (#26)
Dave Fisher [Fri, 20 Aug 2021 20:13:20 +0000 (13:13 -0700)] 
asfindex plugin for site index (#26)

* asfindex content generation

* Settings for asfindex plugin / scope on index

* Abandon Menu Generation

While index generation is generalizable menu generation is not.

10 months agoOF: document condition
Sebb [Wed, 21 Jul 2021 10:46:17 +0000 (11:46 +0100)] 
OF: document condition

10 months agoDocument script purpose
sebbASF [Wed, 21 Jul 2021 10:28:47 +0000 (11:28 +0100)] 
Document script purpose

10 months agoOF: unnecessary (and wrong)
Sebb [Tue, 20 Jul 2021 22:03:34 +0000 (23:03 +0100)] 
OF: unnecessary (and wrong)

The pelican command creates the output directory as necessary.
In any case, the default in buildsite.py is site-generated not /site-generated.

10 months agoUse requirements.txt (#22)
sebbASF [Tue, 20 Jul 2021 19:10:03 +0000 (20:10 +0100)] 
Use requirements.txt (#22)

10 months agoOF: Cleanup Dockerfile installs - add DOCKER.md (#20)
Dave Fisher [Tue, 20 Jul 2021 19:00:13 +0000 (12:00 -0700)] 
OF: Cleanup Dockerfile installs - add DOCKER.md (#20)

* OF: Cleanup Dockerfile installs - add DOCKER.md

* Update DOCKER.md

10 months agoOF: Avoid: --bind without --listen has no effect (#18)
sebbASF [Mon, 19 Jul 2021 15:09:20 +0000 (16:09 +0100)] 
OF: Avoid: --bind without --listen has no effect (#18)

Does not impact buildbot

10 months agoMerge pull request #16 from apache/dave/smaller-docker-image
sebbASF [Mon, 19 Jul 2021 10:31:52 +0000 (11:31 +0100)] 
Merge pull request #16 from apache/dave/smaller-docker-image

Two stage Dockerfile saves 230MB in image

10 months agoTwo phase Dockerfile saves 230MB in image 16/head
Dave Fisher [Sun, 18 Jul 2021 15:56:37 +0000 (08:56 -0700)] 
Two phase Dockerfile saves 230MB in image

10 months agoSimplify docker; build from checkout (#15)
sebbASF [Sun, 18 Jul 2021 15:25:22 +0000 (16:25 +0100)] 
Simplify docker; build from checkout (#15)

* Simplify docker; build from checkout

* Avoid File not found error

* Need to include a file that is displayed if pelicanconf.yaml is missing

* Adding .authtokens to image

* Revert "Adding .authtokens to image"

This reverts commit b760ff708eb6cd1cde3262c2e71b6cb6fb96036f.

* Don't hide missing authtokens

* Get authtokens from site checkout

Co-authored-by: Dave Fisher <dave@davefisher.tech>
10 months agoOF: Dockerfile - use recent commit hash, support all buildsite.py, more examples...
Dave Fisher [Fri, 16 Jul 2021 17:02:02 +0000 (10:02 -0700)] 
OF: Dockerfile - use recent commit hash, support all buildsite.py, more examples  (#13)

* Add subversion and git to Dockerfile, use latest commit hash

* Add additional comments with instructions

10 months agoMerge pull request #11 from bdelacretaz/dockerfile/plugins-commit-hash
Greg Stein [Fri, 16 Jul 2021 07:19:52 +0000 (02:19 -0500)] 
Merge pull request #11 from bdelacretaz/dockerfile/plugins-commit-hash

Mention INFRA_PELICAN_COMMIT in Dockerfile build instructions

10 months agotypo 11/head
Bertrand Delacretaz [Fri, 16 Jul 2021 07:17:10 +0000 (09:17 +0200)] 
typo

10 months agoMention INFRA_PELICAN_COMMIT in build instructions
Bertrand Delacretaz [Fri, 16 Jul 2021 07:12:39 +0000 (09:12 +0200)] 
Mention INFRA_PELICAN_COMMIT in build instructions

10 months agoMerge pull request #10 from apache/sebb/pylint
Greg Stein [Thu, 15 Jul 2021 23:28:28 +0000 (18:28 -0500)] 
Merge pull request #10 from apache/sebb/pylint

Fix an escaped period. Remove unused import. Use 4-space indents.

10 months agoPylint fixes 10/head
Sebb [Thu, 15 Jul 2021 22:55:13 +0000 (23:55 +0100)] 
Pylint fixes

10 months agoTODO
Sebb [Thu, 15 Jul 2021 22:43:53 +0000 (23:43 +0100)] 
TODO

10 months agoOF: fix file name
Sebb [Thu, 15 Jul 2021 22:18:17 +0000 (23:18 +0100)] 
OF: fix file name

10 months agoPlugin is very noisy (#5)
sebbASF [Thu, 15 Jul 2021 21:20:42 +0000 (22:20 +0100)] 
Plugin is very noisy (#5)

10 months agoOF: update plugin architecture
Dave Fisher [Thu, 15 Jul 2021 20:37:16 +0000 (13:37 -0700)] 
OF: update plugin architecture

10 months agoMerge pull request #4 from apache/dave/anomolous-backslash
Greg Stein [Thu, 15 Jul 2021 20:10:17 +0000 (15:10 -0500)] 
Merge pull request #4 from apache/dave/anomolous-backslash

The `\\.` form is clearer, even two the single slash form works in Python.

10 months agoOF: remove required= argument (not available in py3.6)
Greg Stein [Thu, 15 Jul 2021 19:45:52 +0000 (14:45 -0500)] 
OF: remove required= argument (not available in py3.6)

10 months agoMerge pull request #9 from apache/feature/Dockerfile
Greg Stein [Thu, 15 Jul 2021 19:33:26 +0000 (14:33 -0500)] 
Merge pull request #9 from apache/feature/Dockerfile

adds a Dockerfile, creates subcommands for buildsite.py, makes plugin yaml optional/defaulted, and adds some doc for configuring the pelican build via yaml

10 months agoUpdate commit in Dockerfile 9/head
Dave Fisher [Thu, 15 Jul 2021 19:14:06 +0000 (12:14 -0700)] 
Update commit in Dockerfile

10 months agoAdjust args parsing - include args.func(args)
Dave Fisher [Thu, 15 Jul 2021 19:09:59 +0000 (12:09 -0700)] 
Adjust args parsing - include args.func(args)

10 months agoDockerfile with commit hash updated
Dave Fisher [Thu, 15 Jul 2021 17:37:30 +0000 (10:37 -0700)] 
Dockerfile with commit hash updated

10 months agoadd initial help about pelicanconf.yaml
Dave Fisher [Thu, 15 Jul 2021 17:33:18 +0000 (10:33 -0700)] 
add initial help about pelicanconf.yaml

10 months agobuildsite.py now has two commands: git and dir
Dave Fisher [Thu, 15 Jul 2021 16:57:47 +0000 (09:57 -0700)] 
buildsite.py now has two commands: git and dir

10 months agoMerge pull request #8 from apache/feature/allow-empty-plugins
Greg Stein [Wed, 14 Jul 2021 22:58:43 +0000 (17:58 -0500)] 
Merge pull request #8 from apache/feature/allow-empty-plugins

Feature/allow empty plugins

10 months agoOF: Add all plugins to the README (#7)
Dave Fisher [Wed, 14 Jul 2021 22:19:45 +0000 (15:19 -0700)] 
OF: Add all plugins to the README (#7)

* Add all plugins to the README

* Update README.md

* Add pelican architecture notes

10 months agoUpdate gitignore for cmark library installed in place
Dave Fisher [Wed, 14 Jul 2021 21:54:06 +0000 (14:54 -0700)] 
Update gitignore for cmark library installed in place

10 months agoSet checkout to commit point which has build_in_docker.py
Dave Fisher [Wed, 14 Jul 2021 21:29:11 +0000 (14:29 -0700)] 
Set checkout to commit point which has build_in_docker.py

10 months agoIntroduce Dockerfile
Dave Fisher [Wed, 14 Jul 2021 21:18:07 +0000 (14:18 -0700)] 
Introduce Dockerfile

10 months agoFix plugins specification 8/head
Dave Fisher [Wed, 14 Jul 2021 17:28:32 +0000 (10:28 -0700)] 
Fix plugins specification

10 months agoAllow missing plugins directive along with missing path and use
Dave Fisher [Wed, 14 Jul 2021 17:17:05 +0000 (10:17 -0700)] 
Allow missing plugins directive along with missing path and use

10 months agoFixup [ and ] for ezt in download templates
Dave Fisher [Tue, 13 Jul 2021 14:51:23 +0000 (07:51 -0700)] 
Fixup [ and ] for ezt in download templates

10 months agoPer sebb - fix anomolous backslash 4/head
Dave Fisher [Mon, 5 Jul 2021 15:46:44 +0000 (08:46 -0700)] 
Per sebb - fix anomolous backslash

10 months agoOF: unused import
Sebb [Mon, 5 Jul 2021 00:02:20 +0000 (01:02 +0100)] 
OF: unused import

10 months agoMerge pull request #3 from apache/dave/no-single-branch
Greg Stein [Sun, 4 Jul 2021 20:59:25 +0000 (15:59 -0500)] 
Merge pull request #3 from apache/dave/no-single-branch

clone with --depth=1 --no-single-branch

10 months agoclone with --depth=1 --no-single-branch 3/head
Dave Fisher [Sun, 4 Jul 2021 18:11:10 +0000 (11:11 -0700)] 
clone with --depth=1 --no-single-branch

10 months agoMerge pull request #1 from apache/dave/expanded
Greg Stein [Sat, 3 Jul 2021 21:46:06 +0000 (16:46 -0500)] 
Merge pull request #1 from apache/dave/expanded

Add more yaml config for asfdata, asfrun, and asfcopy plugins. Update asfgenid. Debug buildsite.py

10 months agoSome tweaks to generate_settings() 1/head
Greg Stein [Sat, 3 Jul 2021 21:45:01 +0000 (16:45 -0500)] 
Some tweaks to generate_settings()

10 months agoMinor edits
Greg Stein [Sat, 3 Jul 2021 21:38:31 +0000 (16:38 -0500)] 
Minor edits

10 months agoupdate to asfgenid
Dave Fisher [Sat, 3 Jul 2021 19:52:06 +0000 (12:52 -0700)] 
update to asfgenid

10 months agoremove extra data
Dave Fisher [Sat, 3 Jul 2021 19:26:20 +0000 (12:26 -0700)] 
remove extra data

10 months agotop level debug in yaml
Dave Fisher [Sat, 3 Jul 2021 19:22:04 +0000 (12:22 -0700)] 
top level debug in yaml

10 months agocode review
Dave Fisher [Sat, 3 Jul 2021 18:54:18 +0000 (11:54 -0700)] 
code review

10 months agoAdd asfdata, asfrun, and asfcopy plugins. Update asfgenid. Debug.
Dave Fisher [Sat, 3 Jul 2021 16:52:47 +0000 (09:52 -0700)] 
Add asfdata, asfrun, and asfcopy plugins. Update asfgenid. Debug.

10 months agodev/test improvements: --listen mode and requirements.txt not processed msg
Dave Fisher [Fri, 2 Jul 2021 18:32:52 +0000 (11:32 -0700)] 
dev/test improvements: --listen mode and requirements.txt not processed msg

10 months agouse --quiet rather than printing diffs. implies --exit-code
Greg Stein [Thu, 1 Jul 2021 20:51:48 +0000 (15:51 -0500)] 
use --quiet rather than printing diffs. implies --exit-code

10 months agofix path to the builtin plugins
Greg Stein [Thu, 1 Jul 2021 20:36:29 +0000 (15:36 -0500)] 
fix path to the builtin plugins

10 months agoAvoid committing, if no changes. Do more work in dev/test environ, but do not push.
Greg Stein [Thu, 1 Jul 2021 20:32:23 +0000 (15:32 -0500)] 
Avoid committing, if no changes. Do more work in dev/test environ, but do not push.

10 months agoSet PAGE_TRANSLATION_ID = None and TIMEZONE = 'UTC'
Dave Fisher [Thu, 1 Jul 2021 19:13:49 +0000 (12:13 -0700)] 
Set PAGE_TRANSLATION_ID = None and TIMEZONE = 'UTC'

10 months agosimple script to build/compare pelican builds
Greg Stein [Mon, 28 Jun 2021 04:48:31 +0000 (23:48 -0500)] 
simple script to build/compare pelican builds

10 months agoImprove the template for auto-settings.
Greg Stein [Sat, 26 Jun 2021 05:31:41 +0000 (00:31 -0500)] 
Improve the template for auto-settings.

* include the THEME
* ezt sees [alpha ... so use whitespace after [ rather than [[]
* specify PAGE_PATHS and STATIC_PATHS
* use the {path_no_ext} pattern, as the default
  - future: deal with subdirs for the pages (eg. petri)
* disable Articles
* disable processing of .html files

10 months agoTheme should be in the conf, not cmdline.
Greg Stein [Sat, 26 Jun 2021 05:22:02 +0000 (00:22 -0500)] 
Theme should be in the conf, not cmdline.

- remove the --theme arg from buildsite.py
- pelicanconf.py can specify THEME
- pelicanconf.yaml can specify theme:

(the .ezt mapping the theme is a future commit)

10 months agoRemove duplicate debug genid param.
Greg Stein [Sat, 26 Jun 2021 00:04:57 +0000 (19:04 -0500)] 
Remove duplicate debug genid param.

10 months agoTweaks to the auto-settings.
Greg Stein [Fri, 25 Jun 2021 20:27:49 +0000 (15:27 -0500)] 
Tweaks to the auto-settings.

* add default of False for the boolean options, if they are
  not specified
* add the "debug" genid option

10 months agoTweak the regex for headers
Greg Stein [Thu, 24 Jun 2021 05:56:09 +0000 (00:56 -0500)] 
Tweak the regex for headers

10 months agoUse the GFMReader's new module name.
Greg Stein [Thu, 24 Jun 2021 05:30:43 +0000 (00:30 -0500)] 
Use the GFMReader's new module name.

10 months agoAdd the plugin, if the yaml configures it.
Greg Stein [Thu, 24 Jun 2021 05:18:59 +0000 (00:18 -0500)] 
Add the plugin, if the yaml configures it.

10 months agoAdd YAML config for the asfgenid plugin.
Greg Stein [Thu, 24 Jun 2021 05:13:27 +0000 (00:13 -0500)] 
Add YAML config for the asfgenid plugin.

If the 'genid' section is present in the yaml, then configure
ASF_GENID within the auto settings.

10 months agoComment tweak for using grab.sh
Greg Stein [Tue, 22 Jun 2021 07:52:24 +0000 (02:52 -0500)] 
Comment tweak for using grab.sh

10 months agoMove gfm.py to plugins/
Greg Stein [Tue, 22 Jun 2021 07:35:46 +0000 (02:35 -0500)] 
Move gfm.py to plugins/

10 months agoEnable Pelican builds using YAML config.
Greg Stein [Tue, 22 Jun 2021 07:26:12 +0000 (02:26 -0500)] 
Enable Pelican builds using YAML config.

Rather than an arbitrary .py config/settings input file, we move the
"standard ASF settings" into a .yaml file. The YAML input is passed
through an EZT template to automatically produce a .py file to be
passed into Pelican.

* pelican.auto.ezt: new template for the auto-settings
* buildsite.py:
  - tweak imports
  - (AUTO_SETTINGS*): specify the various auto-settings filenames
  - conditionally load requirements.txt, based on IS_PRODUCTION
  - no longer copy plugins around, as we'll be smarter with PLUGIN_PATHS
  - if "pelicanconf.yaml" exists, then generate a settings file from
    the contents of the .yaml
  - if no such .yaml, then assume a class "pelicanconf.py" and append
    some PLUGINS into that file. Undesireable, but good for a stopgap.
  - when invoking Pelican, pass the (maybe-auto) settings file
  - new generate_settings() to map a .yaml to a .py using the template

11 months agoMerge branch 'master' of https://github.com/apache/infrastructure-pelican
Dave Fisher [Wed, 16 Jun 2021 15:48:40 +0000 (08:48 -0700)] 
Merge branch 'master' of https://github.com/apache/infrastructure-pelican

11 months agoput things back
Dave Fisher [Wed, 16 Jun 2021 15:45:37 +0000 (08:45 -0700)] 
put things back

11 months agospecify path
Gav [Wed, 16 Jun 2021 15:19:08 +0000 (17:19 +0200)] 
specify path

11 months agochange path
Gav [Wed, 16 Jun 2021 12:54:15 +0000 (14:54 +0200)] 
change path

11 months agoOF: typo
Sebb [Wed, 16 Jun 2021 12:22:27 +0000 (13:22 +0100)] 
OF: typo

11 months agoMove pelican-gfm into plugins
Dave Fisher [Wed, 16 Jun 2021 12:14:00 +0000 (05:14 -0700)] 
Move pelican-gfm into plugins

11 months agoUpdate README.md
sebbASF [Wed, 16 Jun 2021 11:53:31 +0000 (12:53 +0100)] 
Update README.md

11 months agoignore __pycache__
Greg Stein [Mon, 14 Jun 2021 21:08:34 +0000 (16:08 -0500)] 
ignore __pycache__

11 months agoMerge branch 'master' of https://github.com/apache/infrastructure-pelican
Greg Stein [Mon, 14 Jun 2021 21:08:21 +0000 (16:08 -0500)] 
Merge branch 'master' of https://github.com/apache/infrastructure-pelican

11 months agoadd ALv2 license
Greg Stein [Mon, 14 Jun 2021 21:08:08 +0000 (16:08 -0500)] 
add ALv2 license

11 months agoCreate README.md
Greg Stein [Mon, 14 Jun 2021 21:03:58 +0000 (16:03 -0500)] 
Create README.md

Describe the available/standard plugins

11 months agoCreate requirements.txt
Greg Stein [Mon, 14 Jun 2021 20:59:21 +0000 (15:59 -0500)] 
Create requirements.txt

Used by `bin/kick_build.py`

11 months agoUpdate README.md
Greg Stein [Mon, 14 Jun 2021 13:14:43 +0000 (08:14 -0500)] 
Update README.md

Provide example usage of kick_build.py

11 months agoQuick script to kick off a site rebuild.
Greg Stein [Mon, 14 Jun 2021 13:10:19 +0000 (08:10 -0500)] 
Quick script to kick off a site rebuild.

11 months agoUpdate README.md
Greg Stein [Thu, 10 Jun 2021 07:12:39 +0000 (02:12 -0500)] 
Update README.md