Add source code files to llms-full.txt (#24)
This commit is contained in:
@@ -125,6 +125,50 @@ You can exclude specific pages from being included in the generated files:
|
||||
|
||||
This is useful for excluding auto-generated pages, indexes, or content that isn't relevant for LLM consumption.
|
||||
|
||||
.. _including_code_files:
|
||||
|
||||
Including Source Code Files
|
||||
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||
|
||||
You can include source code files from your project at the end of :confval:`llms_txt_full_filename`.
|
||||
|
||||
Use include/exclude syntax to precisely control which files are included:
|
||||
|
||||
.. code-block:: python
|
||||
|
||||
llms_txt_code_files = [
|
||||
"+:src/**/*.py", # Include all Python files in src
|
||||
"-:src/**/__pycache__/**", # Exclude Python cache files
|
||||
]
|
||||
|
||||
Pattern syntax:
|
||||
|
||||
- **+:pattern**: Include files matching the pattern. Processed first to collect matching files.
|
||||
- **-:pattern**: Exclude files matching the pattern. Applied to filter out unwanted files.
|
||||
|
||||
Code files are processed as follows:
|
||||
|
||||
- **Glob patterns**: Use standard glob patterns (``*``, ``**``, ``?``) to match files
|
||||
- **Relative paths**: Patterns are resolved relative to your Sphinx source directory
|
||||
- **Formatting**: Each file is presented with a title and syntax-highlighted code block
|
||||
|
||||
.. _customizing_code_paths:
|
||||
|
||||
Customizing Code File Paths
|
||||
~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
||||
|
||||
By default, the extension automatically detects the relative path from your Sphinx source directory to the git root and strips that prefix from displayed file paths. You can customize this behavior:
|
||||
|
||||
.. code-block:: python
|
||||
|
||||
# Manually specify base path to strip
|
||||
llms_txt_code_base_path = "../../"
|
||||
|
||||
# Disable path stripping entirely
|
||||
llms_txt_code_base_path = ""
|
||||
|
||||
This helps create cleaner, more readable file paths in the generated documentation.
|
||||
|
||||
.. _using_html_baseurl:
|
||||
|
||||
Using HTML Base URL
|
||||
@@ -168,3 +212,11 @@ Here's a complete example showing multiple :doc:`configuration-values`:
|
||||
|
||||
# Content filtering
|
||||
llms_txt_exclude = ["search", "genindex", "404", "private_*"]
|
||||
|
||||
# Source code inclusion with include/exclude patterns
|
||||
llms_txt_code_files = [
|
||||
"+:../../src/**/*.py", # Include Python files
|
||||
"+:../../config/*.yaml", # Include config files
|
||||
"-:../../src/**/__pycache__/**", # Exclude cache files
|
||||
]
|
||||
llms_txt_code_base_path = "../../"
|
||||
|
||||
@@ -15,6 +15,7 @@ import subprocess
|
||||
project = "sphinx-llms-txt"
|
||||
copyright = "Jared Dillard"
|
||||
author = "Jared Dillard"
|
||||
llms_txt_code_files = ["+:../../sphinx_llms_txt/*.py"]
|
||||
llms_txt_summary = """
|
||||
A Sphinx extension that generates a summary llms.txt file,written in Markdown,
|
||||
and a single combined documentation llms-full.txt file, written in reStructuredText.
|
||||
|
||||
@@ -82,3 +82,22 @@ Project Configuration Values
|
||||
See :ref:`excluding_content`.
|
||||
|
||||
.. versionadded:: 0.2.1
|
||||
|
||||
.. confval:: llms_txt_code_files
|
||||
|
||||
- **Type**: list of strings
|
||||
- **Default**: ``[]``
|
||||
- **Description**: A list of glob patterns that appends source code files to :confval:`llms_txt_full_filename`.
|
||||
See :ref:`including_code_files`.
|
||||
|
||||
.. versionadded:: 0.4.0
|
||||
|
||||
.. confval:: llms_txt_code_base_path
|
||||
|
||||
- **Type**: string or ``None``
|
||||
- **Default**: ``None`` (auto-detect from git root)
|
||||
- **Description**: Base path to strip from code file paths when displaying titles.
|
||||
When ``None``, automatically detects the relative path from the Sphinx source
|
||||
directory to the git root and strips that prefix from file paths.
|
||||
|
||||
.. versionadded:: 0.4.0
|
||||
|
||||
Reference in New Issue
Block a user