mirror of
https://github.com/zebrajr/faceswap.git
synced 2025-12-06 00:20:09 +01:00
* model_refactor (#571) * original model to new structure * IAE model to new structure * OriginalHiRes to new structure * Fix trainer for different resolutions * Initial config implementation * Configparse library added * improved training data loader * dfaker model working * Add logging to training functions * Non blocking input for cli training * Add error handling to threads. Add non-mp queues to queue_handler * Improved Model Building and NNMeta * refactor lib/models * training refactor. DFL H128 model Implementation * Dfaker - use hashes * Move timelapse. Remove perceptual loss arg * Update INSTALL.md. Add logger formatting. Update Dfaker training * DFL h128 partially ported * Add mask to dfaker (#573) * Remove old models. Add mask to dfaker * dfl mask. Make masks selectable in config (#575) * DFL H128 Mask. Mask type selectable in config. * remove gan_v2_2 * Creating Input Size config for models Creating Input Size config for models Will be used downstream in converters. Also name change of image_shape to input_shape to clarify ( for future models with potentially different output_shapes) * Add mask loss options to config * MTCNN options to config.ini. Remove GAN config. Update USAGE.md * Add sliders for numerical values in GUI * Add config plugins menu to gui. Validate config * Only backup model if loss has dropped. Get training working again * bugfixes * Standardise loss printing * GUI idle cpu fixes. Graph loss fix. * mutli-gpu logging bugfix * Merge branch 'staging' into train_refactor * backup state file * Crash protection: Only backup if both total losses have dropped * Port OriginalHiRes_RC4 to train_refactor (OriginalHiRes) * Load and save model structure with weights * Slight code update * Improve config loader. Add subpixel opt to all models. Config to state * Show samples... wrong input * Remove AE topology. Add input/output shapes to State * Port original_villain (birb/VillainGuy) model to faceswap * Add plugin info to GUI config pages * Load input shape from state. IAE Config options. * Fix transform_kwargs. Coverage to ratio. Bugfix mask detection * Suppress keras userwarnings. Automate zoom. Coverage_ratio to model def. * Consolidation of converters & refactor (#574) * Consolidation of converters & refactor Initial Upload of alpha Items - consolidate convert_mased & convert_adjust into one converter -add average color adjust to convert_masked -allow mask transition blur size to be a fixed integer of pixels and a fraction of the facial mask size -allow erosion/dilation size to be a fixed integer of pixels and a fraction of the facial mask size -eliminate redundant type conversions to avoid multiple round-off errors -refactor loops for vectorization/speed -reorganize for clarity & style changes TODO - bug/issues with warping the new face onto a transparent old image...use a cleanup mask for now - issues with mask border giving black ring at zero erosion .. investigate - remove GAN ?? - test enlargment factors of umeyama standard face .. match to coverage factor - make enlargment factor a model parameter - remove convert_adjusted and referencing code when finished * Update Convert_Masked.py default blur size of 2 to match original... description of enlargement tests breakout matrxi scaling into def * Enlargment scale as a cli parameter * Update cli.py * dynamic interpolation algorithm Compute x & y scale factors from the affine matrix on the fly by QR decomp. Choose interpolation alogrithm for the affine warp based on an upsample or downsample for each image * input size input size from config * fix issues with <1.0 erosion * Update convert.py * Update Convert_Adjust.py more work on the way to merginf * Clean up help note on sharpen * cleanup seamless * Delete Convert_Adjust.py * Update umeyama.py * Update training_data.py * swapping * segmentation stub * changes to convert.str * Update masked.py * Backwards compatibility fix for models Get converter running * Convert: Move masks to class. bugfix blur_size some linting * mask fix * convert fixes - missing facehull_rect re-added - coverage to % - corrected coverage logic - cleanup of gui option ordering * Update cli.py * default for blur * Update masked.py * added preliminary low_mem version of OriginalHighRes model plugin * Code cleanup, minor fixes * Update masked.py * Update masked.py * Add dfl mask to convert * histogram fix & seamless location * update * revert * bugfix: Load actual configuration in gui * Standardize nn_blocks * Update cli.py * Minor code amends * Fix Original HiRes model * Add masks to preview output for mask trainers refactor trainer.__base.py * Masked trainers converter support * convert bugfix * Bugfix: Converter for masked (dfl/dfaker) trainers * Additional Losses (#592) * initial upload * Delete blur.py * default initializer = He instead of Glorot (#588) * Allow kernel_initializer to be overridable * Add ICNR Initializer option for upscale on all models. * Hopefully fixes RSoDs with original-highres model plugin * remove debug line * Original-HighRes model plugin Red Screen of Death fix, take #2 * Move global options to _base. Rename Villain model * clipnorm and res block biases * scale the end of res block * res block * dfaker pre-activation res * OHRES pre-activation * villain pre-activation * tabs/space in nn_blocks * fix for histogram with mask all set to zero * fix to prevent two networks with same name * GUI: Wider tooltips. Improve TQDM capture * Fix regex bug * Convert padding=48 to ratio of image size * Add size option to alignments tool extract * Pass through training image size to convert from model * Convert: Pull training coverage from model * convert: coverage, blur and erode to percent * simplify matrix scaling * ordering of sliders in train * Add matrix scaling to utils. Use interpolation in lib.aligner transform * masked.py Import get_matrix_scaling from utils * fix circular import * Update masked.py * quick fix for matrix scaling * testing thus for now * tqdm regex capture bugfix * Minor ammends * blur size cleanup * Remove coverage option from convert (Now cascades from model) * Implement convert for all model types * Add mask option and coverage option to all existing models * bugfix for model loading on convert * debug print removal * Bugfix for masks in dfl_h128 and iae * Update preview display. Add preview scaling to cli * mask notes * Delete training_data_v2.py errant file * training data variables * Fix timelapse function * Add new config items to state file for legacy purposes * Slight GUI tweak * Raise exception if problem with loaded model * Add Tensorboard support (Logs stored in model directory) * ICNR fix * loss bugfix * convert bugfix * Move ini files to config folder. Make TensorBoard optional * Fix training data for unbalanced inputs/outputs * Fix config "none" test * Keep helptext in .ini files when saving config from GUI * Remove frame_dims from alignments * Add no-flip and warp-to-landmarks cli options * Revert OHR to RC4_fix version * Fix lowmem mode on OHR model * padding to variable * Save models in parallel threads * Speed-up of res_block stability * Automated Reflection Padding * Reflect Padding as a training option Includes auto-calculation of proper padding shapes, input_shapes, output_shapes Flag included in config now * rest of reflect padding * Move TB logging to cli. Session info to state file * Add session iterations to state file * Add recent files to menu. GUI code tidy up * [GUI] Fix recent file list update issue * Add correct loss names to TensorBoard logs * Update live graph to use TensorBoard and remove animation * Fix analysis tab. GUI optimizations * Analysis Graph popup to Tensorboard Logs * [GUI] Bug fix for graphing for models with hypens in name * [GUI] Correctly split loss to tabs during training * [GUI] Add loss type selection to analysis graph * Fix store command name in recent files. Switch to correct tab on open * [GUI] Disable training graph when 'no-logs' is selected * Fix graphing race condition * rename original_hires model to unbalanced
349 lines
14 KiB
Python
349 lines
14 KiB
Python
#!/usr/bin python3
|
|
""" Configure Plugins popup of the Faceswap GUI """
|
|
|
|
from configparser import ConfigParser
|
|
import logging
|
|
import tkinter as tk
|
|
|
|
from tkinter import ttk
|
|
|
|
from .tooltip import Tooltip
|
|
from .utils import get_config, ContextMenu, set_slider_rounding
|
|
|
|
logger = logging.getLogger(__name__) # pylint: disable=invalid-name
|
|
POPUP = dict()
|
|
|
|
|
|
def popup_config(config, root):
|
|
""" Close any open popup and open requested popup """
|
|
if POPUP:
|
|
p_key = list(POPUP.keys())[0]
|
|
logger.debug("Closing open popup: '%s'", p_key)
|
|
POPUP[p_key].destroy()
|
|
del POPUP[p_key]
|
|
window = ConfigurePlugins(config, root)
|
|
POPUP[config[0]] = window
|
|
|
|
|
|
class ConfigurePlugins(tk.Toplevel):
|
|
""" Pop up for detailed graph/stats for selected session """
|
|
def __init__(self, config, root):
|
|
logger.debug("Initializing %s", self.__class__.__name__)
|
|
super().__init__()
|
|
name, self.config = config
|
|
self.title("{} Plugins".format(name.title()))
|
|
self.set_geometry(root)
|
|
|
|
self.page_frame = ttk.Frame(self)
|
|
self.page_frame.pack(fill=tk.BOTH, expand=True)
|
|
|
|
self.plugin_info = dict()
|
|
self.config_dict_gui = self.get_config()
|
|
self.build()
|
|
self.update()
|
|
logger.debug("Initialized %s", self.__class__.__name__)
|
|
|
|
def set_geometry(self, root):
|
|
""" Set pop-up geometry """
|
|
scaling_factor = get_config().scaling_factor
|
|
pos_x = root.winfo_x() + 80
|
|
pos_y = root.winfo_y() + 80
|
|
width = int(720 * scaling_factor)
|
|
height = int(400 * scaling_factor)
|
|
logger.debug("Pop up Geometry: %sx%s, %s+%s", width, height, pos_x, pos_y)
|
|
self.geometry("{}x{}+{}+{}".format(width, height, pos_x, pos_y))
|
|
|
|
def get_config(self):
|
|
""" Format config into useful format for GUI and pull default value if a value has not
|
|
been supplied """
|
|
logger.debug("Formatting Config for GUI")
|
|
conf = dict()
|
|
for section in self.config.config.sections():
|
|
self.config.section = section
|
|
category = section.split(".")[0]
|
|
options = self.config.defaults[section]
|
|
conf.setdefault(category, dict())[section] = options
|
|
for key in options.keys():
|
|
if key == "helptext":
|
|
self.plugin_info[section] = options[key]
|
|
continue
|
|
options[key]["value"] = self.config.config_dict.get(key, options[key]["default"])
|
|
logger.debug("Formatted Config for GUI: %s", conf)
|
|
return conf
|
|
|
|
def build(self):
|
|
""" Build the config popup """
|
|
logger.debug("Building plugin config popup")
|
|
container = ttk.Notebook(self.page_frame)
|
|
container.pack(fill=tk.BOTH, expand=True)
|
|
categories = sorted(list(key for key in self.config_dict_gui.keys()))
|
|
if "global" in categories: # Move global to first item
|
|
categories.insert(0, categories.pop(categories.index("global")))
|
|
for category in categories:
|
|
page = self.build_page(container, category)
|
|
container.add(page, text=category.title())
|
|
|
|
self.add_frame_separator()
|
|
self.add_actions()
|
|
logger.debug("Built plugin config popup")
|
|
|
|
def build_page(self, container, category):
|
|
""" Build a plugin config page """
|
|
logger.debug("Building plugin config page: '%s'", category)
|
|
plugins = sorted(list(key for key in self.config_dict_gui[category].keys()))
|
|
if any(plugin != category for plugin in plugins):
|
|
page = ttk.Notebook(container)
|
|
page.pack(side=tk.TOP, fill=tk.BOTH, expand=True)
|
|
for plugin in plugins:
|
|
frame = ConfigFrame(page,
|
|
self.config_dict_gui[category][plugin],
|
|
self.plugin_info[plugin])
|
|
title = plugin[plugin.rfind(".") + 1:]
|
|
title = title.replace("_", " ").title()
|
|
page.add(frame, text=title)
|
|
else:
|
|
page = ConfigFrame(container,
|
|
self.config_dict_gui[category][plugins[0]],
|
|
self.plugin_info[plugins[0]])
|
|
|
|
logger.debug("Built plugin config page: '%s'", category)
|
|
|
|
return page
|
|
|
|
def add_frame_separator(self):
|
|
""" Add a separator between top and bottom frames """
|
|
logger.debug("Add frame seperator")
|
|
sep = ttk.Frame(self.page_frame, height=2, relief=tk.RIDGE)
|
|
sep.pack(fill=tk.X, pady=(5, 0), side=tk.BOTTOM)
|
|
logger.debug("Added frame seperator")
|
|
|
|
def add_actions(self):
|
|
""" Add Action buttons """
|
|
logger.debug("Add action buttons")
|
|
frame = ttk.Frame(self.page_frame)
|
|
frame.pack(fill=tk.BOTH, padx=5, pady=5, side=tk.BOTTOM)
|
|
btn_cls = ttk.Button(frame, text="Cancel", width=10, command=self.destroy)
|
|
btn_cls.pack(padx=2, side=tk.RIGHT)
|
|
btn_ok = ttk.Button(frame, text="OK", width=10, command=self.save_config)
|
|
btn_ok.pack(padx=2, side=tk.RIGHT)
|
|
logger.debug("Added action buttons")
|
|
|
|
def save_config(self):
|
|
""" Save the config file """
|
|
logger.debug("Saving config")
|
|
options = {sect: opts
|
|
for value in self.config_dict_gui.values()
|
|
for sect, opts in value.items()}
|
|
|
|
new_config = ConfigParser(allow_no_value=True)
|
|
for section, items in self.config.defaults.items():
|
|
logger.debug("Adding section: '%s')", section)
|
|
self.config.insert_config_section(section, items["helptext"], config=new_config)
|
|
for item, def_opt in items.items():
|
|
if item == "helptext":
|
|
continue
|
|
new_opt = options[section][item]
|
|
logger.debug("Adding option: (item: '%s', default: '%s' new: '%s'",
|
|
item, def_opt, new_opt)
|
|
helptext = def_opt["helptext"]
|
|
helptext += self.config.set_helptext_choices(def_opt)
|
|
helptext += "\n[Default: {}]".format(def_opt["default"])
|
|
helptext = self.config.format_help(helptext, is_section=False)
|
|
new_config.set(section, helptext)
|
|
new_config.set(section, item, str(new_opt["selected"].get()))
|
|
self.config.config = new_config
|
|
self.config.save_config()
|
|
print("Saved config: '{}'".format(self.config.configfile))
|
|
self.destroy()
|
|
logger.debug("Saved config")
|
|
|
|
|
|
class ConfigFrame(ttk.Frame): # pylint: disable=too-many-ancestors
|
|
""" Config Frame - Holds the Options for config """
|
|
|
|
def __init__(self, parent, options, plugin_info):
|
|
logger.debug("Initializing %s", self.__class__.__name__)
|
|
ttk.Frame.__init__(self, parent)
|
|
self.pack(side=tk.TOP, fill=tk.BOTH, expand=True)
|
|
|
|
self.options = options
|
|
self.plugin_info = plugin_info
|
|
|
|
self.canvas = tk.Canvas(self, bd=0, highlightthickness=0)
|
|
self.canvas.pack(side=tk.LEFT, fill=tk.BOTH, expand=True)
|
|
|
|
self.optsframe = ttk.Frame(self.canvas)
|
|
self.optscanvas = self.canvas.create_window((0, 0), window=self.optsframe, anchor=tk.NW)
|
|
|
|
self.build_frame()
|
|
logger.debug("Initialized %s", self.__class__.__name__)
|
|
|
|
def build_frame(self):
|
|
""" Build the options frame for this command """
|
|
logger.debug("Add Config Frame")
|
|
self.add_scrollbar()
|
|
self.canvas.bind("<Configure>", self.resize_frame)
|
|
|
|
self.add_info()
|
|
for key, val in self.options.items():
|
|
if key == "helptext":
|
|
continue
|
|
OptionControl(key, val, self.optsframe)
|
|
logger.debug("Added Config Frame")
|
|
|
|
def add_scrollbar(self):
|
|
""" Add a scrollbar to the options frame """
|
|
logger.debug("Add Config Scrollbar")
|
|
scrollbar = ttk.Scrollbar(self, command=self.canvas.yview)
|
|
scrollbar.pack(side=tk.RIGHT, fill=tk.Y)
|
|
self.canvas.config(yscrollcommand=scrollbar.set)
|
|
self.optsframe.bind("<Configure>", self.update_scrollbar)
|
|
logger.debug("Added Config Scrollbar")
|
|
|
|
def update_scrollbar(self, event): # pylint: disable=unused-argument
|
|
""" Update the options frame scrollbar """
|
|
self.canvas.configure(scrollregion=self.canvas.bbox("all"))
|
|
|
|
def resize_frame(self, event):
|
|
""" Resize the options frame to fit the canvas """
|
|
logger.debug("Resize Config Frame")
|
|
canvas_width = event.width
|
|
self.canvas.itemconfig(self.optscanvas, width=canvas_width)
|
|
logger.debug("Resized Config Frame")
|
|
|
|
def add_info(self):
|
|
""" Plugin information """
|
|
info_frame = ttk.Frame(self.optsframe)
|
|
info_frame.pack(fill=tk.X, expand=True)
|
|
lbl = ttk.Label(info_frame, text="About:", width=20, anchor=tk.W)
|
|
lbl.pack(padx=5, pady=5, side=tk.LEFT, anchor=tk.N)
|
|
info = ttk.Label(info_frame, text=self.plugin_info)
|
|
info.pack(padx=5, pady=5, fill=tk.X, expand=True)
|
|
|
|
|
|
class OptionControl():
|
|
""" Build the correct control for the option parsed and place it on the
|
|
frame """
|
|
|
|
def __init__(self, title, values, option_frame):
|
|
logger.debug("Initializing %s", self.__class__.__name__)
|
|
self.title = title
|
|
self.values = values
|
|
self.option_frame = option_frame
|
|
|
|
self.control = self.set_control()
|
|
self.control_frame = self.set_control_frame()
|
|
self.tk_var = self.set_tk_var()
|
|
|
|
self.build_full_control()
|
|
logger.debug("Initialized %s", self.__class__.__name__)
|
|
|
|
@property
|
|
def helptext(self):
|
|
""" Format the help text for tooltips """
|
|
logger.debug("Format control help: '%s'", self.title)
|
|
helptext = self.values.get("helptext", "")
|
|
helptext = helptext.replace("\n\t", "\n - ").replace("%%", "%")
|
|
helptext = self.title + " - " + helptext
|
|
logger.debug("Formatted control help: (title: '%s', help: '%s'", self.title, helptext)
|
|
return helptext
|
|
|
|
def set_control(self):
|
|
""" Set the correct control type for this option """
|
|
dtype = self.values["type"]
|
|
choices = self.values["choices"]
|
|
if choices:
|
|
control = ttk.Combobox
|
|
elif dtype == bool:
|
|
control = ttk.Checkbutton
|
|
elif dtype in (int, float):
|
|
control = ttk.Scale
|
|
else:
|
|
control = ttk.Entry
|
|
logger.debug("Setting control '%s' to %s", self.title, control)
|
|
return control
|
|
|
|
def set_control_frame(self):
|
|
""" Frame to hold control and it's label """
|
|
logger.debug("Build config control frame")
|
|
frame = ttk.Frame(self.option_frame)
|
|
frame.pack(fill=tk.X, expand=True)
|
|
logger.debug("Built confog control frame")
|
|
return frame
|
|
|
|
def set_tk_var(self):
|
|
""" Correct variable type for control """
|
|
logger.debug("Setting config variable type: '%s'", self.title)
|
|
var = tk.BooleanVar if self.control == ttk.Checkbutton else tk.StringVar
|
|
var = var(self.control_frame)
|
|
logger.debug("Set config variable type: ('%s': %s", self.title, type(var))
|
|
return var
|
|
|
|
def build_full_control(self):
|
|
""" Build the correct control type for the option passed through """
|
|
logger.debug("Build confog option control")
|
|
self.build_control_label()
|
|
self.build_one_control()
|
|
self.values["selected"] = self.tk_var
|
|
logger.debug("Built option control")
|
|
|
|
def build_control_label(self):
|
|
""" Label for control """
|
|
logger.debug("Build config control label: '%s'", self.title)
|
|
title = self.title.replace("_", " ").title()
|
|
lbl = ttk.Label(self.control_frame, text=title, width=20, anchor=tk.W)
|
|
lbl.pack(padx=5, pady=5, side=tk.LEFT, anchor=tk.N)
|
|
logger.debug("Built config control label: '%s'", self.title)
|
|
|
|
def build_one_control(self):
|
|
""" Build and place the option controls """
|
|
logger.debug("Build control: (title: '%s', values: %s)", self.title, self.values)
|
|
self.tk_var.set(self.values["value"])
|
|
|
|
if self.control == ttk.Scale:
|
|
self.slider_control()
|
|
else:
|
|
self.control_to_optionsframe()
|
|
logger.debug("Built control: '%s'", self.title)
|
|
|
|
def slider_control(self):
|
|
""" A slider control with corresponding Entry box """
|
|
logger.debug("Add slider control to Config Options Frame: %s", self.control)
|
|
d_type = self.values["type"]
|
|
rnd = self.values["rounding"]
|
|
min_max = self.values["min_max"]
|
|
|
|
tbox = ttk.Entry(self.control_frame, width=8, textvariable=self.tk_var, justify=tk.RIGHT)
|
|
tbox.pack(padx=(0, 5), side=tk.RIGHT)
|
|
ctl = self.control(
|
|
self.control_frame,
|
|
variable=self.tk_var,
|
|
command=lambda val, var=self.tk_var, dt=d_type, rn=rnd, mm=min_max:
|
|
set_slider_rounding(val, var, dt, rn, mm))
|
|
ctl.pack(padx=5, pady=5, fill=tk.X, expand=True)
|
|
rc_menu = ContextMenu(ctl)
|
|
rc_menu.cm_bind()
|
|
ctl["from_"] = min_max[0]
|
|
ctl["to"] = min_max[1]
|
|
|
|
Tooltip(ctl, text=self.helptext, wraplength=720)
|
|
Tooltip(tbox, text=self.helptext, wraplength=720)
|
|
logger.debug("Added slider control to Options Frame: %s", self.control)
|
|
|
|
def control_to_optionsframe(self):
|
|
""" Standard non-check buttons sit in the main options frame """
|
|
logger.debug("Add control to Options Frame: %s", self.control)
|
|
choices = self.values["choices"]
|
|
if self.control == ttk.Checkbutton:
|
|
ctl = self.control(self.control_frame, variable=self.tk_var, text=None)
|
|
else:
|
|
ctl = self.control(self.control_frame, textvariable=self.tk_var)
|
|
ctl.pack(padx=5, pady=5, fill=tk.X, expand=True)
|
|
rc_menu = ContextMenu(ctl)
|
|
rc_menu.cm_bind()
|
|
if choices:
|
|
logger.debug("Adding combo choices: %s", choices)
|
|
ctl["values"] = [choice for choice in choices]
|
|
Tooltip(ctl, text=self.helptext, wraplength=720)
|
|
logger.debug("Added control to Options Frame: %s", self.control)
|