# = HISTORY SECTION ===================================================================== # --------------------------------------------------------------------------------------- # version | date | author | changes # --------------------------------------------------------------------------------------- # 1.11 |17.04.07| JSTENZEL | renamed fileOptions2prefixes() into _fileOptions2prefixes(), # | | | in order to avoid POD documentation because it is an # | | | internal helper function; # | | JSTENZEL | slight adaptations after complaints of perlcritic; # | | JSTENZEL | added POD hints that GetOptions() is imported from # | | | Getopt::Long and not defined in Getopt::ArgvFile; # | | JSTENZEL | POD: bugfix in GetOptions() calls, %options hash needs to # | | | be passed in as reference; # |21.04.07| JSTENZEL | POD: bugfix in -fileOption example; # 1.10 |05.01.05| JSTENZEL | added options resolveRelativePathes and resolveEnvVars; # 1.09 |19.10.04| JSTENZEL | option -startupFilename now accepts array references both # | | | directly set up and supplied by a callback; # |20.10.04| JSTENZEL | new option -fileOption allows to use a user defined option # | | | instead of an option file prefix like "@" (-options options # | | | instead of @options); # 1.08 |30.04.04| JSTENZEL | new import() switch "justload"; # 1.07 |29.04.04| JSTENZEL | import() implemented directly: emulating the old behaviour # | | | of Exporter::import() when necessary, it alternatively # | | | allows to invoke argvFile() via use(); # 1.06 |03.05.02| JSTENZEL | the startup filename scheme is now configurable by the # | | | new option "startupFilename"; # 1.05 |30.04.02| JSTENZEL | cosmetics: hash access without quotes; # | | JSTENZEL | corrected and improved inline doc; # | | JSTENZEL | using File::Spec::Functions to build filenames, # | | | for improved portability; # | | JSTENZEL | using Cwd::abs_path() to check if files were read already; # | | JSTENZEL | added support for default files in *current* directory; # 1.04 |29.10.00| JSTENZEL | bugfix: options were read twice if both default and home # | | | startup options were read and the script was installed in # | | | the users homedirectory; # 1.03 |25.03.00| JSTENZEL | new parameter "prefix"; # | | JSTENZEL | POD in option files is now supported; # | | JSTENZEL | using Test in test suite now; # 1.02 |27.02.00| JSTENZEL | new parameter "array"; # | | JSTENZEL | slight POD adaptions; # 1.01 |23.03.99| JSTENZEL | README update only; # 1.00 |16.03.99| JSTENZEL | first CPAN version. # --------------------------------------------------------------------------------------- # = POD SECTION ========================================================================= =head1 NAME Getopt::ArgvFile - interpolates script options from files into @ARGV or another array =head1 VERSION This manual describes version B<1.11>. =head1 SYNOPSIS One line invocation - option hints are processed while the module is loaded: # load module and process option file hints in @ARGV use Getopt::ArgvFile default=>1; # load another module to evaluate the options, e.g.: use Getopt::Long; ... # evaluate options, e.g. this common way: GetOptions(\%options, 'any'); # this function is defined in Getopt::Long Or suppress option hint processing when the module is loaded, to perform it later on: # load module, do *not* process option file hints use Getopt::ArgvFile justload=>1; # load another module to evaluate the options, e.g.: use Getopt::Long; ... # *now*, solve option file hints Getopt::ArgvFile::argvFile(default=>1); # evaluate options, e.g. this common way: GetOptions(\%options, 'any'); # this function is defined in Getopt::Long Or use the traditional two step invocation of module loading with I and I option file handling: # Load the module and import the &argvFile symbol # - this will *not* process option hints. # Use *this* syntax to do so, *exactly*. use Getopt::ArgvFile qw(argvFile); # load another module to evaluate the options, e.g.: use Getopt::Long; ... # *now*, solve option file hints argvFile(default=>1); # evaluate options, e.g. this common way: GetOptions(\%options, 'any'); # this function is defined in Getopt::Long If options should be processed into another array, this can be done this way: # prepare target array my @options=('@options1', '@options2', '@options3'); ... # replace file hints by the options stored in the files argvFile(array=>\@options); In case you do not like the "@" prefix it is possible to define an option to be used instead: # prepare target array my @options=('-options', 'options1', '-options', 'options2'); ... # replace file hints by the options stored in the files argvFile(fileOption=>'options', array=>\@options); =head1 DESCRIPTION This module simply interpolates option file hints in @ARGV by the contents of the pointed files. This enables option reading from I instead of or additional to the usual reading from the command line. Alternatively, you can process any array instead of @ARGV which is used by default and mentioned mostly in this manual. The interpolated @ARGV could be subsequently processed by the usual option handling, e.g. by a Getopt::xxx module. Getopt::ArgvFile does I perform any option handling itself, it only prepares the array @ARGV. Option files can significantly simplify the call of a script. Imagine the following: =over 4 =item Breaking command line limits A script may offer a lot of options, with possibly a few of them even taking parameters. If these options and their parameters are passed onto the program call directly, the number of characters accepted by your shells command line may be exceeded. Perl itself does I limit the number of characters passed to a script by parameters, but the shell or command interpreter often I a limit here. The same problem may occur if you want to store a long call in a system file like crontab. If such a limit restricts you, options and parameters may be moved into option files, which will result in a shorter command line call. =item Script calls prepared by scripts Sometimes a script calls another script. The options passed onto the nested script could depend on variable situations, such as a users input or the detected environment. In such a case, it I be easier to generate an intermediate option file which is then passed to the nested script. Or imagine two cron jobs one preparing the other: the first may generate an option file which is then used by the second. =item Simple access to typical calling scenarios If several options need to be set, but in certain circumstances are always the same, it could become sligthly nerveracking to type them in again and again. With an option file, they can be stored I and recalled easily as often as necessary. Further more, option files may be used to group options. Several settings may set up one certain behaviour of the program, while others influence another. Or a certain set of options may be useful in one typical situation, while another one should be used elsewhere. Or there is a common set of options which has to be used in every call, while other options are added depending on the current needs. Or there are a few user groups with different but typical ways to call your script. In all these cases, option files may collect options belonging together, and may be combined by the script users to set up a certain call. In conjunction with the possiblity to I such collections, this is perhaps the most powerful feature provided by this method. =item Individual and installationwide default options The module allows the programmer to enable user setups of default options; for both individual users or generally I callers of a script. This is especially useful for administrators who can configure the I behaviour of a script by setting up its installationwide startup option file. All script users are free then to completely forget every already configured setup option. And if one of them regularly adds certain options to every call, he could store them in his I startup option file. For example, I use this feature to make my scripts both flexible I usable. I have several scripts accessing a database via DBI. The database account parameters as well as the DBI startup settings should not be coded inside the scripts because this is not very flexible, so I implemented them by options. But on the other hand, there should be no need for a normal user to pass all these settings to every script call. My solution for this is to use I option files set up and maintained by an administrator. This is very transparent, most of the users know nothing of these (documented ;-) configuration settings ... and if anything changes, only the option files have to be adapted. =back =cut # PACKAGE SECTION ############################################### # declare namespace package Getopt::ArgvFile; # declare your revision (and use it to avoid a warning) $VERSION=1.11; $VERSION=$VERSION; # force Perl version require 5.003; =pod =head1 EXPORTS No symbol is exported by default, but you may explicitly import the "argvFile()" function I: use Getopt::ArgvFile qw(argvFile); Please note that this interface is provided for backwards compatibility with versions up to 1.06. By loading the module this way, the traditional import mechanisms take affect and I is not called implicitly>. This means that while option file hints are usually processed implicitly when C is loaded, the syntax use Getopt::ArgvFile qw(argvFile); requires an I call of I to process option files. =cut # export something (Exporter is not made a base module because we implement import() ourselves, # which *can* call Exporter::import() (if needed for backwards compatibility) - see import()) require Exporter; @EXPORT_OK=qw(argvFile); # CODE SECTION ################################################## # set pragmas use strict; # load libraries use Carp; use File::Basename; use Text::ParseWords; use File::Spec::Functions; use Cwd qw(:DEFAULT abs_path chdir); # module variables my $optionPrefixPattern=qr/(-{1,2}|\+)/; # METHOD SECTION ################################################ =pod =head1 FUNCTIONS There is only one function, I, which does all the work of option file hint processing. Please note that with version 1.07 and above C is called I when the module is loaded, except this is done in one of the following ways: # the traditional interface - provided for # backwards compatibility - this loads the # module and imports the &argvFile symbol use Getopt::ArgvFile qw(argvFile); -- # option file processing is explicitly suppressed use Getopt::ArgvFile justload=>1; Except for the traditional loading, the complete interface of C is available via C, but in the typical C syntax without parantheses. # implicit call of argvFile(default=>1, home=>1) use Getopt::ArgvFile default=>1, home=>1; See I for further details. =head2 argvFile() Scans the command line parameters (stored in @ARGV or an alternatively passed array) for option file hints (see I below), reads the pointed files and makes their contents part of the source array (@ARGV by default) replacing the hints. Because the function was intentionally designed to work on @ARGV and this is still the default behaviour, this manual mostly speaks about @ARGV. Please note that it is possible to process I other array as well. B An option file hint is simply the filename preceeded by (at least) one "@" character: > script -optA argA -optB @optionFile -optC argC This will cause argvFile() to scan "optionFile" for options. The element "@optionFile" will be removed from the @ARGV array and will be replaced by the options found. Note: you can choose another prefix by using the "prefix" parameter, see below. An option file which cannot be found is quietly skipped. Well, what is I an option file? It is intended to store I which should be passed to the called script. They can be stored exactly as they would be written in the command line, but may be spread to multiple lines. To make the file more readable, space and comment lines (starting with a "#") are allowed additionally. POD comments are supported as well. For example, the call > script -optA argA -optB -optC cArg par1 par2 could be transformed into > script @scriptOptions par1 par2 where the file "scriptOptions" may look like this: # option a -optA argA C<> =pod option b =cut -optB C<> # option c -optC cArg B Option files can be nested. Recursion is avoided globally, that means that every file will be opened only I (the first time argvFile() finds a hint pointing to it). This is the simplest implementation, indeed, but should be suitable. (Unfortunately, there are I.) By using this feature, you may combine groups of typical options into a top level option file, e.g.: File ab: C<> # option a -optA argA # option b -optB C<> File c: C<> # option c -optC cArg C<> File abc: C<> # combine ab and c @ab @c If anyone provides these files, a user can use a very short call: > script @abc and argvFile() will recursively move all the filed program parameters into @ARGV. B Pathes in option files might be relative, as in -file ../file @../../configs/nested If written with the (prepared) start directory in mind, that will work, but it can fail when it was written relatively to the option file location because by default those pathes will not be resolved when written from an option file. Use parameter C to switch to path resolution: argvFile(resolveRelativePathes=>1); will cause C to expand those pathes, both in standard strings and nested option files. With resolveRelativePathes, both pathes will be resolved: -file ../file @../../configs/nested A path is resolved I it is found in. B Similar to relative pathes, environment variables are handled differently depending if the option is specified at the commandline or from an option file, due to bypassed shell processing. By default, C does not resolve environment variables. But if required it can be commanded to do so via parameter C. argvFile(resolveEnvVars=>1); B By setting several named parameters, you can enable automatic processing of I. There are three of them: The I is searched in the installation path of the calling script, the I is searched in the users home (evaluated via environment variable "HOME"), and the I is searched in the current directory. By default, all startup option files are expected to be named like the script, preceeded by a dot, but this can be adapted to individual needs if preferred, see below. Examples: If a script located in "/path/script" is invoked in directory /the/current/dir by a user "user" whoms "HOME" variable points to "/homes/user", the following happens: C<> argvFile() # ignores all startup option files; argvFile(default=>1) # searches and expands "/path/.script", # if available (the "default" settings); argvFile(home=>1) # searches and expands "/homes/user/.script", # if available (the "home" settings); argvFile(current=>1) # searches and expands "/the/current/dir/.script", # if available (the "current" settings); argvFile( default => 1, home => 1, current => 1 ) # tries to handle all startups. Any true value will activate the setting it is assigned to. In case the ".script" name rule does not meet your needs or does not fit into a certain policy, the expected startup filenames can be set up by an option C. The option value may be a scalar used as the expected filename, or a reference to an array of accepted choices, or a reference to code returning the name - plainly or as a reference to an array of names. Such callback code will be called I and will receive the name of the script. # use ".config" argvFile(startupFilename => '.config'); # use ".config" or "config" argvFile(startupFilename => [qw(.config config)]); # emulate the default behaviour, # but use an extra dot postfix my $nameBuilder=sub {join('', '.', basename($_[0]), '.');}; argvFile(startupFilename => $nameBuilder); # use .(script)rc or .(script)/config my $nameBuilder=sub { my $sname=basename($_[0]); [".${sname}rc", ".${sname}/config"]; }; argvFile(startupFilename => $nameBuilder); Note that the list variants will use the first matching filename in each possible startup-file path. For example if your array is C<['.scriptrc', '.script.config']> and you have both a C<.scriptrc> and a C<.script.config> file in (say) your current directory, only the C<.scriptrc> file will be used, as it is the first found. The contents found in a startup file is placed I all explicitly set command line arguments. This enables to overwrite a default setting by an explicit option. If all startup files are read, I startup files can overwrite I files which have preceedence over I ones, so that the I startups are most common. In other words, if the module would not support startup files, you could get the same result with "script @/path/.script @/homes/user/.script @/the/current/dir/.script". Note: There is one certain case when overwriting will I work completely because duplicates are sorted out: if all three types of startup files are used and the script is started in the installation directory, the default file will be identical to the current file. The default file is processed, but the current file is skipped as a duplicate later on and will I overwrite settings made caused by the intermediately processed home file. If started in another directory, it I overwrite the home settings. But the alternative seems to be even more confusing: the script would behave differently if just started in its installation path. Because a user might be more aware of configuration editing then of the current path, I choose the current implementation, but this preceedence might become configurable in a future version. If there is no I environment variable, the I setting takes no effect to avoid trouble accessing the root directory. B The function supports multi-level (or so called I) option files. If a filename in an option file hint starts with a "@" again, this complete name is the resolution written back to @ARGV - assuming there will be another utility reading option files. Examples: @rfile rfile will be opened, its contents is made part of @ARGV. @@rfile cascade: "@rfile" is written back to @ARGV assuming that there is a subsequent tool called by the script to which this hint will be passed to solve it by an own call of argvFile(). The number of cascaded hints is unlimited. B Although the function was designed to process @ARGV, it is possible to process another array as well if you prefer. To do this, simply pass a I to this array by parameter B. Examples: argvFile() # processes @ARGV; argvFile(array=>\@options); # processes @options; B By default, "@" is the prefix used to mark an option file. This can be changed by using the optional parameter B: Examples: argvFile(); # use "@"; argvFile(prefix=>'~'); # use "~"; Note that the strings "#", "=", "-" and "+" are reserved and I be chosen here because they are used to start plain or POD comments or are typically option prefixes. B People not familiar with option files might be confused by file prefixes. This can be avoided by offering an I