Spec-Zone .ru
спецификации, руководства, описания, API
|
The cluster restoration program is implemented as a separate command-line utility ndb_restore, which can normally be found in the MySQL bin
directory. This program reads the files created as a result of the backup and
inserts the stored information into the database.
ndb_restore must be executed once for each of the backup files
that were created by the START BACKUP
command used to create the backup (see Section 17.5.3.2, "Using
The MySQL Cluster Management Client to Create a Backup"). This is equal to the number of data nodes in
the cluster at the time that the backup was created.
Before using ndb_restore, it is recommended that the cluster be running in single user mode, unless you are restoring multiple data nodes in parallel. See Section 17.5.8, "MySQL Cluster Single User Mode", for more information.
The following table includes options that are specific to the MySQL Cluster native backup restoration program ndb_restore. Additional descriptions follow the table. For options common to most MySQL Cluster programs (including ndb_restore), see Section 17.4.25, "Options Common to MySQL Cluster Programs — Options Common to MySQL Cluster Programs".
Table 17.22. ndb_restore Options and Variables: MySQL Cluster NDB7.3
Format | Description | Added / Removed |
---|---|---|
Same as connectstring | All MySQL 5.6 based releases |
|
Back up files from node with this ID | All MySQL 5.6 based releases |
|
Restore from the backup with the given ID | All MySQL 5.6 based releases |
|
Restore table data and logs into NDB Cluster using the NDB API | All MySQL 5.6 based releases |
|
Restore metadata to NDB Cluster using the NDB API | All MySQL 5.6 based releases |
|
Do not upgrade array type for varsize attributes which do not already resize VAR data, and do not change column attributes | All MySQL 5.6 based releases |
|
Allow attributes to be promoted when restoring data from backup | All MySQL 5.6 based releases |
|
Allow preservation of trailing spaces (including padding) when promoting fixed-width string types to variable-width types | All MySQL 5.6 based releases |
|
Do not restore objects relating to Disk Data | All MySQL 5.6 based releases |
|
Restore epoch info into the status table. Convenient on a MySQL Cluster replication slave for starting replication. The row in mysql.ndb_apply_status with id 0 will be updated/inserted. | All MySQL 5.6 based releases |
|
Skip table structure check during restoring of data | All MySQL 5.6 based releases |
|
Number of parallel transactions to use while restoring data | All MySQL 5.6 based releases |
|
Print metadata, data and log to stdout (equivalent to --print_meta --print_data --print_log) | All MySQL 5.6 based releases |
|
Print metadata to stdout | All MySQL 5.6 based releases |
|
Print data to stdout | All MySQL 5.6 based releases |
|
Print to stdout | All MySQL 5.6 based releases |
|
Path to backup files directory | All MySQL 5.6 based releases |
|
Do not ignore system table during restore. Experimental only; not for production use | All MySQL 5.6 based releases |
|
Nodegroup map for NDBCLUSTER storage engine. Syntax: list of (source_nodegroup, destination_nodegroup) | All MySQL 5.6 based releases |
|
Fields are enclosed with the indicated character | All MySQL 5.6 based releases |
|
Fields are terminated by the indicated character | All MySQL 5.6 based releases |
|
Fields are optionally enclosed with the indicated character | All MySQL 5.6 based releases |
|
Lines are terminated by the indicated character | All MySQL 5.6 based releases |
|
Print binary types in hexadecimal format | All MySQL 5.6 based releases |
|
Creates a tab-separated .txt file for each table in the given path | All MySQL 5.6 based releases |
|
Append data to a tab-delimited file | All MySQL 5.6 based releases |
|
Print status of restoration each given number of seconds | All MySQL 5.6 based releases |
|
If a mysqld is connected and using binary logging, do not log the restored data | All MySQL 5.6 based releases |
|
Level of verbosity in output | All MySQL 5.6 based releases |
|
List of one or more databases to restore (excludes those not named) | All MySQL 5.6 based releases |
|
List of one or more databases to exclude (includes those not named) | All MySQL 5.6 based releases |
|
List of one or more tables to restore (excludes those in same database that are not named); each table reference must include the database name | All MySQL 5.6 based releases |
|
List of one or more tables to exclude (includes those in same database that are not not named); each table reference must include the database name | All MySQL 5.6 based releases |
|
Causes columns from the backup version of a table that are missing from the version of the table in the database to be ignored. | All MySQL 5.6 based releases |
|
Causes indexes from a backup to be ignored; may decrease time needed to restore data. | All MySQL 5.6 based releases |
|
Causes multi-threaded ordered index rebuilding of indexes found in the backup. | All MySQL 5.6 based releases |
|
Causes missing blob tables in the backup file to be ignored. | All MySQL 5.6 based releases |
|
Causes schema objects not recognized by ndb_restore to be ignored when restoring a backup made from a newer MySQL Cluster version to an older version. | All MySQL 5.6 based releases |
|
Restores to a database with a different name than the original | All MySQL 5.6 based releases |
|
Allow lossy conversions of column values (type demotions or changes in sign) when restoring data from backup | All MySQL 5.6 based releases |
|
Restore MySQL privilege tables that were previously moved to NDB. | All MySQL 5.6 based releases |
Typical options for this utility are shown here:
ndb_restore [-cconnectstring
] -nnode_id
[-m] -bbackup_id
\ -r --backup_path=/path/to/backup/files
The -c
option is used to specify a connectstring which tells ndb_restore
where to locate
the cluster management server. (See Section 17.3.2.3, "The
MySQL Cluster Connectstring", for information on connectstrings.) If this option is not used, then ndb_restore attempts to connect to a management server on
localhost:1186
. This utility acts as a cluster API node, and so requires a free
connection "slot" to connect to the cluster management
server. This means that there must be at least one [api]
or [mysqld]
section that can be used by it in the cluster config.ini
file. It is a good idea
to keep at least one empty [api]
or [mysqld]
section
in config.ini
that is not being used for a MySQL server or other application for
this reason (see Section 17.3.2.7,
"Defining SQL and Other API Nodes in a MySQL Cluster").
You can verify that ndb_restore is connected to the cluster by using the SHOW command in the ndb_mgm management client. You can also accomplish this from a system shell, as shown here:
shell> ndb_mgm -e "SHOW"
-n
is used to specify the node ID of the data node on which the backups were taken.
The first time you run the ndb_restore restoration program, you also need to restore the
metadata. In other words, you must re-create the database tables—this can be done by running it with the --restore_meta
(-m
) option. Restoring the metdata need
be done only on a single data node; this is sufficient to restore it to the entire cluster. Note that the
cluster should have an empty database when starting to restore a backup. (In other words, you should start ndbd with --initial
prior to
performing the restore.)
It is possible
to restore data without restoring table metadata. The default behavior when doing this is for ndb_restore to fail with an error if table data do not match
the table schema; this can be overridden using the --skip-table-check
or -s
option.
Some of the restrictions on mismatches in column definitions when restoring data using ndb_restore are relaxed; when one of these types of mismatches
is encountered, ndb_restore
does not stop with an error as it did previously, but rather accepts the data and inserts it into the target
table while issuing a warning to the user that this is being done. This behavior occurs whether or not either of
the options --skip-table-check
or --promote-attributes
is in use. These differences in column definitions are of
the following types:
Different COLUMN_FORMAT
settings (FIXED
, DYNAMIC
, DEFAULT
)
Different STORAGE
settings (MEMORY
,
DISK
)
Different default values
Different distribution key settings
ndb_restore supports limited attribute
promotion in much the same way that it is supported by MySQL replication; that is, data backed up from a
column of a given type can generally be restored to a column using a "larger, similar"
type. For example, data from a CHAR(20)
column can be restored to a column declared
as VARCHAR(20)
, VARCHAR(30)
, or CHAR(30)
;
data from a MEDIUMINT
column can be restored to a column of type INT
or BIGINT
. See Section
16.4.1.9.2, "Replication of Columns Having Different Data Types", for a table of type conversions
currently supported by attribute promotion.
Attribute promotion by ndb_restore must be enabled explicitly, as follows:
Prepare the table to which the backup is to be restored. ndb_restore cannot be used to re-create the table with a
different definition from the original; this means that you must either create the table manually, or
alter the columns which you wish to promote using ALTER TABLE
after restoring the table metadata but before restoring
the data.
Invoke ndb_restore with the --promote-attributes
option (short form -A
)
when restoring the table data. Attribute promotion does not occur if this option is not used; instead,
the restore operation fails with an error.
Command-Line Format | --lossy-conversions |
||
-L |
|||
Permitted Values | |||
Type | boolean |
||
Default | FALSE |
This option is intended to complement the --promote-attributes
option. Using --lossy-conversions
allows lossy conversions of column values (type demotions or changes in sign) when restoring data from backup.
With some exceptions, the rules governing demotion are the same as for MySQL replication; see Section
16.4.1.9.2, "Replication of Columns Having Different Data Types", for information about specific type
conversions currently supported by attribute demotion.
ndb_restore reports any truncation of data that it performs during lossy conversions once per attribute and column.
The
--preserve-trailing-spaces
option (short form -R
) causes
trailing spaces to be preserved when promoting a fixed-width character data type to its variable-width
equivalent—that is, when promoting a CHAR
column value to VARCHAR
or a BINARY
column value to VARBINARY
. Otherwise,
any trailing spaces are dropped from such column values when they are inserted into the new columns.
Although you can promote CHAR
columns to VARCHAR
and BINARY
columns to VARBINARY
, you cannot promote VARCHAR
columns to CHAR
or VARBINARY
columns to BINARY
.
The -b
option is used to specify the ID or sequence number of the backup, and is the same
number shown by the management client in the Backup
message displayed upon completion of a backup. (See Section
17.5.3.2, "Using The MySQL Cluster Management Client to Create a Backup".)backup_id
completed
When restoring cluster backups, you must be sure to restore all data nodes from backups having the same backup ID. Using files from different backups will at best result in restoring the cluster to an inconsistent state, and may fail altogether.
--restore_epoch
(short form: -e
) adds (or restores) epoch
information to the cluster replication status table. This is useful for starting replication on a MySQL Cluster
replication slave. When this option is used, the row in the mysql.ndb_apply_status
having 0
in the id
column is updated if it already
exists; such a row is inserted if it does not already exist. (See Section
17.6.9, "MySQL Cluster Backups With MySQL Cluster Replication".)
This option causes ndb_restore to output NDB
table data and logs.
This option causes ndb_restore to print NDB
table metadata. Generally, you need only use this option when restoring the
first data node of a cluster; additional data nodes can obtain the metadata from the first one.
ndb_restore does not by default restore distributed MySQL privilege tables. This option causes ndb_restore to restore the privilege tables.
This works only if the privilege tables were converted to NDB
before the backup was taken. For more information, see Section
17.5.14, "Distributed MySQL Privileges for MySQL Cluster".
The path to the backup directory is required; this is supplied to ndb_restore using the --backup_path
option, and must include the subdirectory corresponding to the ID backup of the backup to be restored. For
example, if the data node's DataDir
is /var/lib/mysql-cluster
, then the
backup directory is /var/lib/mysql-cluster/BACKUP
, and the backup files for the
backup with the ID 3 can be found in /var/lib/mysql-cluster/BACKUP/BACKUP-3
. The
path may be absolute or relative to the directory in which the ndb_restore executable is located, and may be optionally
prefixed with backup_path=
.
It is possible to restore a backup to a database with a different configuration than it was created from. For
example, suppose that a backup with backup ID 12
, created in a cluster with two
database nodes having the node IDs 2
and 3
, is to be
restored to a cluster with four nodes. Then ndb_restore must be run twice—once for each database node in
the cluster where the backup was taken. However, ndb_restore cannot always restore backups made from a
cluster running one version of MySQL to a cluster running a different MySQL version. See Section
17.2.8, "Upgrading and Downgrading MySQL Cluster NDB 7.3", for more information.
It is not possible to restore a backup made from a newer version of MySQL Cluster using an older version of ndb_restore. You can restore a backup made from a newer version of MySQL to an older cluster, but you must use a copy of ndb_restore from the newer MySQL Cluster version to do so.
For example, to restore a cluster backup taken from a cluster running MySQL Cluster NDB 7.2.5 to a cluster running MySQL Cluster NDB 7.1.21, you must use the ndb_restore that comes with the MySQL Cluster NDB 7.2.5 distribution.
For more rapid restoration, the data may be restored in parallel, provided that there is a sufficient number of
cluster connections available. That is, when restoring to multiple nodes in parallel, you must have an [api]
or [mysqld]
section in the cluster config.ini
file available for each concurrent ndb_restore process. However, the data files must always be
applied before the logs.
When using ndb_restore
to restore a backup, VARCHAR
columns created using the old fixed format are resized and recreated using the variable-width format now
employed. This behavior can be overridden using the --no-upgrade
option (short form: -u
) when running
ndb_restore.
The --print_data
option causes ndb_restore to direct its output to stdout
.
TEXT
and BLOB
column values are always truncated to the first 256 bytes in the output;
this cannot currently be overridden when using --print_data
.
Several additional options are available for use with the --print_data
option in
generating data dumps, either to stdout
, or to a file. These are similar to some of
the options used with mysqldump,
and are shown in the following list:
Command-Line Format | --tab=path |
||
-T |
This option causes --print_data
to create dump files, one per table, each named
. It requires as
its argument the path to the directory where the files should be saved; use tbl_name
.txt.
for the current directory.
Command-Line Format | --fields-enclosed-by=char |
||
Permitted Values | |||
Type | string |
||
Default |
|
Each column values are enclosed by the string passed to this option (regardless of data type; see next item).
--fields-optionally-enclosed-by=
string
Command-Line Format | --fields-optionally-enclosed-by |
||
Permitted Values | |||
Type | string |
||
Default |
|
The string passed to this option is used to enclose column values containing character data (such as
CHAR
, VARCHAR
, BINARY
, TEXT
, or ENUM
).
Command-Line Format | --fields-terminated-by=char |
||
Permitted Values | |||
Type | string |
||
Default | \t (tab) |
The string passed to this option is used to separate column values. The default value is a tab
character (\t
).
Command-Line Format | --hex |
If this option is used, all binary values are output in hexadecimal format.
Command-Line Format | --fields-terminated-by=char |
||
Permitted Values | |||
Type | string |
||
Default | \t (tab) |
This option specifies the string used to end each line of output. The default is a linefeed
character (\n
).
Command-Line Format | --append |
When used with the --tab
and --print_data
options, this causes the data to be appended to any
existing files having the same names.
If a table has no explicit primary key, then the output generated when using the --print_data
option includes the table's hidden primary key.
This option causes ndb_restore to print all metadata to stdout
.
The --print_log
option causes ndb_restore to output its log to stdout
.
Causes ndb_restore
to print all data, metadata, and logs to stdout
. Equivalent to using the --print_data
, --print_meta
, and --print_log
options together.
Use of --print
or any of the --print_*
options is in effect performing a dry run. Including one or more of these options causes any output to be
redirected to stdout
; in such cases, ndb_restore makes no attempt to restore data or metadata
to a MySQL Cluster.
Normally, when restoring table data and metadata, ndb_restore ignores the copy of the NDB
system table that is present in the backup. --dont_ignore_systab_0
causes the system table to be restored. This option is intended for experimental and
development use only, and is not recommended in a production environment.
This option can be used to restore a backup taken from one node group to a different node group. Its argument is
a list of the form
. source_node_group
, target_node_group
This option prevents any connected SQL nodes from writing data restored by ndb_restore to their binary logs.
This option stops ndb_restore from restoring any MySQL Cluster Disk Data objects, such as tablespaces and log file groups; see Section 17.5.12, "MySQL Cluster Disk Data Tables", for more information about these.
Determines the maximum number of parallel transactions that ndb_restore tries to use. By default, this is 128; the minimum is 1, and the maximum is 1024.
Print a status report each N
seconds while the backup is in progress.
0 (the default) causes no status reports to be printed. The maximum is 65535.
Sets the level for the verbosity of the output. The minimum is 0; the maximum is 255. The default value is 1.
It is possible to restore only selected databases, or selected tables from a single database, using the syntax shown here:
ndb_restoreother_options
db_name
,[db_name
[,...] |tbl_name
[,tbl_name
][,...]]
In other words, you can specify either of the following to be restored:
All tables from one or more databases
One or more tables from a single database
--include-databases=
db_name
[,db_name
][,...]
Command-Line Format | --include-databases=db-list |
||
Permitted Values | |||
Type | string |
||
Default |
|
--include-tables=
db_name.tbl_name
[,db_name.tbl_name
][,...]
Command-Line Format | --include-tables=table-list |
||
Permitted Values | |||
Type | string |
||
Default |
|
Use the --include-databases
option or the --include-tables
option for restoring only specific databases or
tables, respectively. --include-databases
takes a comma-delimited list of databases
to be restored. --include-tables
takes a comma-delimited list of tables (in
format) to be restored. database
.table
When --include-databases
or --include-tables
is used,
only those databases or tables named by the option are restored; all other databases and tables are excluded by
ndb_restore, and are not restored.
The following table shows several invocations of ndb_restore using --include-*
options (other options possibly required have been omitted for clarity), and the effects these have on restoring
from a MySQL Cluster backup:
Option Used | Result |
---|---|
--include-databases=db1 |
Only tables in database db1 are restored; all tables in all other
databases are ignored
|
--include-databases=db1,db2 (or --include-databases=db1
--include-databases=db2 )
|
Only tables in databases db1 and db2 are
restored; all tables in all other databases are ignored
|
--include-tables=db1.t1 |
Only table t1 in database db1 is restored;
no other tables in db1 or in any other database are restored
|
--include-tables=db1.t2,db2.t1 (or --include-tables=db1.t2
--include-tables=db2.t1 )
|
Only the table t2 in database db1 and the
table t1 in database db2 are restored; no
other tables in db1 , db2 , or anyother
database are restored
|
You can also use these two options together. For example, the following causes all tables in databases db1
and db2
, together with the tables t1
and t2
in database db3
,
to be restored (and no other databases or tables):
shell> ndb_restore [...] --include-databases=db1,db2
--include-tables=db3.t1,db3.t2
(Again we have omitted other, possibly required, options in the example just shown.)
--exclude-databases=
db_name
[,db_name
][,...]
Command-Line Format | --exclude-databases=db-list |
||
Permitted Values | |||
Type | string |
||
Default |
|
--exclude-tables=
db_name.tbl_name
[,db_name.tbl_name
][,...]
Command-Line Format | --exclude-tables=table-list |
||
Permitted Values | |||
Type | string |
||
Default |
|
It is possible to prevent one or more databases or tables from being restored using the ndb_restore options --exclude-databases
and --exclude-tables
. --exclude-databases
takes a comma-delimited list of one or more databases which should
not be restored. --exclude-tables
takes a comma-delimited list of one or more tables
(using
format) which should not be restored. database
.table
When --exclude-databases
or --exclude-tables
is used,
only those databases or tables named by the option are excluded; all other databases and tables are restored by
ndb_restore.
This table shows several invocations of ndb_restore usng --exclude-*
options
(other options possibly required have been omitted for clarity), and the effects these options have on restoring
from a MySQL Cluster backup:
Option Used | Result |
---|---|
--exclude-databases=db1 |
All tables in all databases except db1 are restored; no tables in db1 are restored
|
--exclude-databases=db1,db2 (or --exclude-databases=db1
--exclude-databases=db2 )
|
All tables in all databases except db1 and db2 are restored; no tables in db1 or db2 are restored
|
--exclude-tables=db1.t1 |
All tables except t1 in database db1 are
restored; all other tables in db1 are restored; all tables in all other
databases are restored
|
--exclude-tables=db1.t2,db2.t1 (or --exclude-tables=db1.t2
--exclude-tables=db2.t1) |
All tables in database db1 except for t2
and all tables in database db2 except for table t1
are restored; no other tables in db1 or db2 arerestored; all tables in all other databases are restored
|
You can use these two options together. For example, the following causes all tables in all databases except for databases db1
and db2
, along with the tables t1
and t2
in database db3
, not to be restored:
shell> ndb_restore [...] --exclude-databases=db1,db2
--exclude-tables=db3.t1,db3.t2
(Again, we have omitted other possibly necessary options in the interest of clarity and brevity from the example just shown.)
You can use --include-*
and --exclude-*
options
together, subject to the following rules:
The actions of all --include-*
and --exclude-*
options are cumulative.
All --include-*
and --exclude-*
options are evaluated in the order passed to ndb_restore, from
right to left.
In the event of conflicting options, the first (rightmost) option takes precedence. In other words, the first option (going from right to left) that matches against a given database or table "wins".
For example, the following set of options causes ndb_restore to restore all tables from database db1
except db1.t1
, while restoring no other tables from
any other databases:
--include-databases=db1 --exclude-tables=db1.t1
However, reversing the order of the options just given simply causes all tables from database db1
to be restored (including db1.t1
, but no tables from
any other database), because the --include-databases
option, being farthest to the right, is the first match
against database db1
and thus takes precedence over any other option that matches
db1
or any tables in db1
:
--exclude-tables=db1.t1 --include-databases=db1
Command-Line Format | --exclude-missing-columns |
It is also possible to restore only selected table columns using the --exclude-missing-columns
option. When this option is used, ndb_restore ignores any columns missing from tables being
restored as compared to the versions of those tables found in the backup. This option applies to all tables
being restored. If you wish to apply this option only to selected tables or databases, you can use it in
combination with one or more of the options described in the previous paragraph to do so, then restore data to
the remaining tables using a complementary set of these options.
Command-Line Format | --disable-indexes |
Disable restoration of indexes during restoration of the data from a native NDB backup. Afterwards, you can
restore indexes for all tables at once with multi-threaded building of indexes using --rebuild-indexes
, which should be faster than rebuilding indexes concurrently
for very large tables.
Command-Line Format | --rebuild-indexes |
You can use this option with ndb_restore to cause multi-threaded rebuilding of the ordered
indexes while restoring a native NDB
backup.
Command-Line Format | --skip-broken-objects |
This option causes ndb_restore to ignore corrupt tables while reading a native NDB
backup, and to continue restoring any remaining tables (that are not also
corrupted). Currently, the --skip-broken-objects
option works only in the case of
missing blob parts tables.
Command-Line Format | --skip-unknown-objects |
This option causes ndb_restore to ignore any schema objects it does not recognize
while reading a native NDB
backup. This can be used for restoring a backup made from a cluster
running MySQL Cluster NDB 7.3 to a cluster running MySQL Cluster NDB 7.2.
--rewrite-database=
old_dbname
,new_dbname
Command-Line Format | --rewrite-database=olddb,newdb |
||
Permitted Values | |||
Type | string |
||
Default | none |
This option makes it possible to restore to a database having a different name from that used in the backup. For
example, if a backup is made of a database named products
, you can restore the data
it contains to a database named inventory
, use this option as shown here (omitting
any other options that might be required):
shell> ndb_restore --rewrite-database=product,inventory
The option can be employed multiple times in a single invocation of ndb_restore. Thus it is possible to restore simultaneously from
a database named db1
to a database named db2
and from
a database named db3
to one named db4
using --rewrite-database=db1,db2 --rewrite-database=db3,db4
. Other ndb_restore options may be used between multiple occurrences
of --rewrite-database
.
In the event of conflicts between multiple --rewrite-database
options, the last
--rewrite-database
option used, reading from left to right, is the one that takes
effect. For example, if --rewrite-database=db1,db2 --rewrite-database=db1,db3
is
used, only --rewrite-database=db1,db3
is honored, and --rewrite-database=db1,db2
is ignored. It is also possible to restore from multiple databases to a single database, so that --rewrite-database=db1,db3 --rewrite-database=db2,db3
restores all tables and data
from databases db1
and db2
into database db3
.
When restoring from multiple backup databases into a single target database using --rewrite-database
, no check is made for collisions between table or other object
names, and the order in which rows are restored is not guaranteed. This means that it is possible in such
cases for rows to be overwritten and updates to be lost.
Error reporting. ndb_restore reports both temporary and permanent errors. In the
case of temporary errors, it may able to recover from them, and reports Restore
successful, but encountered temporary error, please look at configuration
in such cases.
After using ndb_restore
to initialize a MySQL Cluster for use in circular replication, binary logs on the SQL node acting as the
replication slave are not automatically created, and you must cause them to be created manually. To cause
the binary logs to be created, issue a SHOW
TABLES
statement on that SQL node before running START SLAVE
. This is a known issue in MySQL Cluster.