title: Efficient electron transfer in quantum dot chains controlled by a cubic detuning profile via shortcuts to adiabaticity

abstract: Long-distance fast and precise transfer of charge in semiconductor nanostructures is one of the goals for scalable electronic devices. We study theoretically the control of shuttling of an electron along a linear chain of semiconductor electrostatically-defined quantum dots by an electric field pulse with nonlinear time-dependent profile. We show that this essential nonlinearity along with shortcuts to adiabaticity techniques speed up the electron transfer with high fidelity, while still holding great robustness under spin-flip interactions and inhomogeneities in the couplings of the chain. A given fidelity can be set experimentally by controlling the maximum sweep energy and duration of the control pulse


title: Estimation and variable selection in joint mean and dispersion models applied to mixture experiments

abstract: In industrial experiments, controlling variability is of paramount importance to ensure product quality. Classical regression models for mixture experiments are widely used in industry, however, when the assumption of constant variance is not satisfied, the building of procedures that allow minimizing the variability becomes necessary and other methods of statistical modeling should be considered. In this article, we use the class of generalized linear models (GLMs) to build statistical models in mixture experiments. The GLMs class is general and very flexible, generalizing some of the most important probability distributions, and allows modeling the variability through the methodology of the joint modeling of mean and dispersion (JMMD). This paper shows how the JMMD can be used to obtain models for mean and variance in mixture experiments. We give a comprehensive understanding of the procedures for estimating parameters and selecting variables in the JMMD. The variable selection procedure was adapted for the case of mixture experiments, where the verification of constant dispersion is ensured by the existence of only the constant term in the dispersion model; the absence of the constant term or the existence of any other term in the dispersion model implies non-constant dispersion. A simulation study, considering the most common case of Normal distribution, was used to verify the effectiveness of the proposed variable selection procedure. A practical example from the Food Industry was used to illustrate the proposed methodology.


title: Learning Fine Scale Dynamics from Coarse Observations via Inner Recurrence

abstract: Recent work has focused on data-driven learning of the evolution of unknown systems via deep neural networks (DNNs), with the goal of conducting long term prediction of the dynamics of the unknown system. In many real-world applications, data from time-dependent systems are often collected on a time scale that is coarser than desired, due to various restrictions during the data acquisition process. Consequently, the observed dynamics can be severely under-sampled and do not reflect the true dynamics of the underlying system. This paper presents a computational technique to learn the fine-scale dynamics from such coarsely observed data. The method employs inner recurrence of a DNN to recover the fine-scale evolution operator of the underlying system. In addition to mathematical justification, several challenging numerical examples, including unknown systems of both ordinary and partial differential equations, are presented to demonstrate the effectiveness of the proposed method.


title: Clifford Algebras, Quantum Neural Networks and Generalized Quantum Fourier Transform

abstract: We propose models of quantum neural networks through Clifford algebras, which are capable of capturing geometric features of systems and to produce entanglement. Due to their representations in terms of Pauli matrices, the Clifford algebras are the natural framework for multidimensional data analysis in a quantum setting. Implementation of activation functions and unitary learning rules are discussed. In this scheme, we also provide an algebraic generalization of the quantum Fourier transform containing additional parameters that allow performing quantum machine learning. Furthermore, some interesting properties of the generalized quantum Fourier transform have been proved.


title: Conservation of Total Wave Action in the Expanding Solar Wind

abstract: The conservation of wave action in moving plasmas has been well-known for over half a century. However, wave action is not conserved when multiple wave modes propagate and coexist close to degeneration condition (Sound speed equals Alfv\'en speed, i.e. plasma $\beta \sim 1$). Here we show that the violation of conservation is due to wave mode conversion, and that the total wave action summed over interacting modes is still conserved. Though the result is general, we focus on MHD waves and identify three distinctive mode conversion mechanisms, i.e. degeneracy, linear mode conversion, and resonance, and provide an intuitive physical picture for the mode conversion processes. We use 1D MHD simulations with the Expanding Box Model to simulate the nonlinear evolution of monochromatic MHD waves in the expanding solar wind. Simulation results validate the theory; total wave action therefore remains an interesting diagnostic for studies of waves and turbulence in the solar wind.

categories: astro-ph.SR physics.flu-dyn physics.geo-ph physics.space-ph


title: On Periodic Alternate Base Expansions

abstract: For an alternate base $\boldsymbol{\beta}=(\beta_0,\ldots,\beta_{p-1})$, we show that if all rational numbers in the unit interval $[0,1)$ have periodic expansions with respect to the $p$ shifts of $\boldsymbol{\beta}$, then the bases $\beta_0,\ldots,\beta_{p-1}$ all belong to the extension field $\mathbb Q(\beta)$ where $\beta$ is the product $\beta_0\cdots\beta_{p-1}$ and moreover, this product $\beta$ must be either a Pisot or Salem number. We also prove the stronger statement that if the bases $\beta_0,\ldots,\beta_{p-1}$ belong to $\mathbb Q(\beta)$ but the product $\beta$ is neither a Pisot number nor a Salem number then the set of rationals having an ultimately periodic $\boldsymbol{\beta}$-expansion is nowhere dense in $[0,1)$. Moreover, in the case where the product $\beta$ is a Pisot number and the bases $\beta_0,\ldots,\beta_{p-1}$ all belong to $\mathbb Q(\beta)$, we prove that the set of points in $[0,1)$ having an ultimately periodic $\boldsymbol{\beta}$-expansion is precisely the set $\mathbb Q(\beta)\cap[0,1)$. For the restricted case of R\'enyi real bases, i.e., for $p=1$ in our setting, our method gives rise to an elementary proof of Schmidt's original result. Therefore, even though our results generalize those of Schmidt, our proofs should not be seen as generalizations of Schmidt's original arguments but as an original method in the generalized framework of alternate bases, which moreover gives a new elementary proof of Schmidt's results from 1980. As an application of our results, we show that if $\boldsymbol{\beta}=(\beta_0,\ldots,\beta_{p-1})$ is an alternate base such that the product $\beta$ of the bases is a Pisot number and $\beta_0,\ldots,\beta_{p-1}\in\mathbb Q(\beta)$, then $\boldsymbol{\beta}$ is a Parry alternate base, meaning that the quasi-greedy expansions of $1$ with respect to the $p$ shifts of the base $\boldsymbol{\beta}$ are ultimately periodic.


title: Rod magnets inscribed in an elastic cuboid: interpreting single-domain ferroics in Onsager's spirit

abstract: A toy model for ferroic orders through entropy. As the rod/spin concentration (or the volume enclosing the ferroic rods) is variable by a tunable force conjugate to the order parameter, the model exhibits hysteresis associated to some discontinuous isotropic-nematic transitions explained essentially by Onsager's hard-rod model. The uniaxial anisotropy and nonperiodicity by construction is reminiscent of Stoner-Wohlfarth's single-domain magnet, and the toy model may ultimately be seen as a minimalistic for hard ferroics with some possible self-averaging disorders. Spin togglings shall be reliable due to the clean two-well energy landscapes in the athermal transition theory.


title: Challenges to Solving Combinatorially Hard Long-Horizon Deep RL Tasks

abstract: Deep reinforcement learning has shown promise in discrete domains requiring complex reasoning, including games such as Chess, Go, and Hanabi. However, this type of reasoning is less often observed in long-horizon, continuous domains with high-dimensional observations, where instead RL research has predominantly focused on problems with simple high-level structure (e.g. opening a drawer or moving a robot as fast as possible). Inspired by combinatorially hard optimization problems, we propose a set of robotics tasks which admit many distinct solutions at the high-level, but require reasoning about states and rewards thousands of steps into the future for the best performance. Critically, while RL has traditionally suffered on complex, long-horizon tasks due to sparse rewards, our tasks are carefully designed to be solvable without specialized exploration. Nevertheless, our investigation finds that standard RL methods often neglect long-term effects due to discounting, while general-purpose hierarchical RL approaches struggle unless additional abstract domain knowledge can be exploited.


title: Learning sRGB-to-Raw-RGB De-rendering with Content-Aware Metadata

abstract: Most camera images are rendered and saved in the standard RGB (sRGB) format by the camera's hardware. Due to the in-camera photo-finishing routines, nonlinear sRGB images are undesirable for computer vision tasks that assume a direct relationship between pixel values and scene radiance. For such applications, linear raw-RGB sensor images are preferred. Saving images in their raw-RGB format is still uncommon due to the large storage requirement and lack of support by many imaging applications. Several "raw reconstruction" methods have been proposed that utilize specialized metadata sampled from the raw-RGB image at capture time and embedded in the sRGB image. This metadata is used to parameterize a mapping function to de-render the sRGB image back to its original raw-RGB format when needed. Existing raw reconstruction methods rely on simple sampling strategies and global mapping to perform the de-rendering. This paper shows how to improve the de-rendering results by jointly learning sampling and reconstruction. Our experiments show that our learned sampling can adapt to the image content to produce better raw reconstructions than existing methods. We also describe an online fine-tuning strategy for the reconstruction network to improve results further.


title: First semi-empirical test of the white dwarf mass-radius relationship using a single white dwarf via astrometric microlensing

abstract: In November 2019, the nearby single, isolated DQ-type white dwarf LAWD 37 (WD 1142-645) aligned closely with a distant background source and caused an astrometric microlensing event. Leveraging astrometry from \Gaia{} and followup data from the \textit{Hubble Space Telescope} we measure the astrometric deflection of the background source and obtain a gravitational mass for LAWD~37. The main challenge of this analysis is in extracting the lensing signal of the faint background source whilst it is buried in the wings of LAWD~37's point spread function. Removal of LAWD 37's point spread function induces a significant amount of correlated noise which we find can mimic the astrometric lensing signal. We find a deflection model including correlated noise caused by the removal of LAWD~37's point spread function best explains the data and yields a mass for LAWD 37 of $0.56\pm0.08 M_{\odot}$. This mass is in agreement with the theoretical mass-radius relationship and cooling tracks expected for CO core white dwarfs. Furthermore, the mass is consistent with no or trace amounts of hydrogen that is expected for objects with helium-rich atmospheres like LAWD 37. We conclude that further astrometric followup data on the source is likely to improve the inference on LAWD 37's mass at the $\approx3$ percent level and definitively rule out purely correlated noise explanations of the data. This work provides the first semi-empirical test of the white dwarf mass-radius relationship using a single, isolated white dwarf and supports current model atmospheres of DQ white dwarfs and white dwarf evolutionary theory.


title: Option Discovery for Autonomous Generation of Symbolic Knowledge

abstract: In this work we present an empirical study where we demonstrate the possibility of developing an artificial agent that is capable to autonomously explore an experimental scenario. During the exploration, the agent is able to discover and learn interesting options allowing to interact with the environment without any pre-assigned goal, then abstract and re-use the acquired knowledge to solve possible tasks assigned ex-post. We test the system in the so-called Treasure Game domain described in the recent literature and we empirically demonstrate that the discovered options can be abstracted in an probabilistic symbolic planning model (using the PPDDL language), which allowed the agent to generate symbolic plans to achieve extrinsic goals.


title: From $t$-SNE to UMAP with contrastive learning

abstract: Neighbor embedding methods $t$-SNE and UMAP are the de facto standard for visualizing high-dimensional datasets. Motivated from entirely different viewpoints, their loss functions appear to be unrelated. In practice, they yield strongly differing embeddings and can suggest conflicting interpretations of the same data. The fundamental reasons for this and, more generally, the exact relationship between $t$-SNE and UMAP have remained unclear. In this work, we uncover their conceptual connection via a new insight into contrastive learning methods. Noise-contrastive estimation can be used to optimize $t$-SNE, while UMAP relies on negative sampling, another contrastive method. We find the precise relationship between these two contrastive methods and provide a mathematical characterization of the distortion introduced by negative sampling. Visually, this distortion results in UMAP generating more compact embeddings with tighter clusters compared to $t$-SNE. We exploit this new conceptual connection to propose and implement a generalization of negative sampling, allowing us to interpolate between (and even extrapolate beyond) $t$-SNE and UMAP and their respective embeddings. Moving along this spectrum of embeddings leads to a trade-off between discrete / local and continuous / global structures, mitigating the risk of over-interpreting ostensible features of any single embedding. We provide a PyTorch implementation.


title: A High-Order Asymptotic Analysis of the Benjamin-Feir Instability Spectrum in Arbitrary Depth

abstract: We investigate the Benjamin-Feir (or modulational) instability of Stokes waves, i.e., small-amplitude, one-dimensional periodic gravity waves of permanent form and constant velocity, in water of finite and infinite depth. We develop a perturbation method to describe to high-order accuracy the unstable spectral elements associated with this instability, obtained by linearizing Euler's equations about the small-amplitude Stokes waves. These unstable elements form a figure-eight curve centered at the origin of the complex spectral plane, which is parameterized by a Floquet exponent. Our asymptotic expansions of this figure-eight are in excellent agreement with numerical computations as well as recent rigorous results by Berti, Maspero, and Ventura. From our expansions, we derive high-order estimates for the growth rates of the Benjamin-Feir instability and for the parameterization of the Benjamin-Feir figure-eight curve with respect to the Floquet exponent. We are also able to compare the Benjamin-Feir and high-frequency instability spectra analytically for the first time, revealing three different regimes of the Stokes waves, depending on the predominant instability.


title: QAGCN: Answering Multi-Relation Questions via Single-Step Implicit Reasoning over Knowledge Graphs

abstract: Multi-relation question answering (QA) is a challenging task, where given questions usually require long reasoning chains in KGs that consist of multiple relations. Recently, methods with explicit multi-step reasoning over KGs have been prominently used in this task and have demonstrated promising performance. Examples include methods that perform stepwise label propagation through KG triples and methods that navigate over KG triples based on reinforcement learning. A main weakness of these methods is that their reasoning mechanisms are usually complex and difficult to implement or train. In this paper, we argue that multi-relation QA can be achieved via end-to-end single-step implicit reasoning, which is simpler, more efficient, and easier to adopt. We propose QAGCN -- a Question-Aware Graph Convolutional Network (GCN)-based method that includes a novel GCN architecture with controlled question-dependent message propagation for the implicit reasoning. Extensive experiments have been conducted, where QAGCN achieved competitive and even superior performance compared to state-of-the-art explicit-reasoning methods. Our code and pre-trained models are available in the repository: https://github.com/ruijie-wang-uzh/QAGCN


title: Collision of localized shocks in AdS$_5$ as a series expansion in transverse gradients

abstract: We introduce a computational framework to more efficiently calculate the collision of localized shocks in five dimensional asymptotically Anti-de Sitter space. We expand the Einstein equations in transverse gradients and find that our numerical results agree well with exact solutions already at first order in the expansion. Moreover, the Einstein equations at first order in transverse gradients can be decoupled into two sets of differential equations. The bulk fields of one of these sets has only a negligible contribution to boundary observables, such that the computation on each time slice can be simplified to the solution of several planar shockwave equations plus four further differential equations for each transverse plane `pixel'. At the cost of errors of $\lesssim 10 \%$ at the hydrodynamization time and for low to mid rapidities, useful numerical solutions can be sped up by roughly one order of magnitude.


title: A Robust Backpropagation-Free Framework for Images

abstract: While current deep learning algorithms have been successful for a wide variety of artificial intelligence (AI) tasks, including those involving structured image data, they present deep neurophysiological conceptual issues due to their reliance on the gradients that are computed by backpropagation of errors (backprop). Gradients are required to obtain synaptic weight adjustments but require knowledge of feed-forward activities in order to conduct backward propagation, a biologically implausible process. This is known as the "weight transport problem". Therefore, in this work, we present a more biologically plausible approach towards solving the weight transport problem for image data. This approach, which we name the error kernel driven activation alignment (EKDAA) algorithm, accomplishes through the introduction of locally derived error transmission kernels and error maps. Like standard deep learning networks, EKDAA performs the standard forward process via weights and activation functions; however, its backward error computation involves adaptive error kernels that propagate local error signals through the network. The efficacy of EKDAA is demonstrated by performing visual-recognition tasks on the Fashion MNIST, CIFAR-10 and SVHN benchmarks, along with demonstrating its ability to extract visual features from natural color images. Furthermore, in order to demonstrate its non-reliance on gradient computations, results are presented for an EKDAA trained CNN that employs a non-differentiable activation function.


abstract: Humans can effectively find salient regions in complex scenes. Self-attention mechanisms were introduced into Computer Vision (CV) to achieve this. Attention Augmented Convolutional Network (AANet) is a mixture of convolution and self-attention, which increases the accuracy of a typical ResNet. However, The complexity of self-attention is O(n2) in terms of computation and memory usage with respect to the number of input tokens. In this project, we propose EAANet: Efficient Attention Augmented Convolutional Networks, which incorporates efficient self-attention mechanisms in a convolution and self-attention hybrid architecture to reduce the model's memory footprint. Our best model show performance improvement over AA-Net and ResNet18. We also explore different methods to augment Convolutional Network with self-attention mechanisms and show the difficulty of training those methods compared to ResNet. Finally, we show that augmenting efficient self-attention mechanisms with ResNet scales better with input size than normal self-attention mechanisms. Therefore, our EAANet is more capable of working with high-resolution images.


title: HDDL 2.1: Towards Defining an HTN Formalism with Time

abstract: Real world applications of planning, like in industry and robotics, require modelling rich and diverse scenarios. Their resolution usually requires coordinated and concurrent action executions. In several cases, such planning problems are naturally decomposed in a hierarchical way and expressed by a Hierarchical Task Network (HTN) formalism. The PDDL language used to specify planning domains has evolved to cover the different planning paradigms. However, formulating real and complex scenarios where numerical and temporal constraints concur in defining a solution is still a challenge. Our proposition aims at filling the gap between existing planning languages and operational needs. To do so, we propose to extend HDDL taking inspiration from PDDL 2.1 and ANML to express temporal and numerical expressions. This paper opens discussions on the semantics and the syntax needed to extend HDDL, and illustrate these needs with the modelling of an Earth Observing Satellite planning problem.


title: Relevance in Dialogue: Is Less More? An Empirical Comparison of Existing Metrics, and a Novel Simple Metric

abstract: In this work, we evaluate various existing dialogue relevance metrics, find strong dependency on the dataset, often with poor correlation with human scores of relevance, and propose modifications to reduce data requirements and domain sensitivity while improving correlation. Our proposed metric achieves state-of-the-art performance on the HUMOD dataset while reducing measured sensitivity to dataset by 37%-66%. We achieve this without fine-tuning a pretrained language model, and using only 3,750 unannotated human dialogues and a single negative example. Despite these limitations, we demonstrate competitive performance on four datasets from different domains. Our code, including our metric and experiments, is open sourced.


title: Estimation of Over-parameterized Models from an Auto-Modeling Perspective

abstract: From a model-building perspective, we propose a paradigm shift for fitting over-parameterized models. Philosophically, the mindset is to fit models to future observations rather than to the observed sample. Technically, given an imputation method to generate future observations, we fit over-parameterized models to these future observations by optimizing an approximation of the desired expected loss function based on its sample counterpart and an adaptive $\textit{duality function}$. The required imputation method is also developed using the same estimation technique with an adaptive $m$-out-of-$n$ bootstrap approach. We illustrate its applications with the many-normal-means problem, $n < p$ linear regression, and neural network-based image classification of MNIST digits. The numerical results demonstrate its superior performance across these diverse applications. While primarily expository, the paper conducts an in-depth investigation into the theoretical aspects of the topic. It concludes with remarks on some open problems.


title: Debiased Machine Learning without Sample-Splitting for Stable Estimators

abstract: Estimation and inference on causal parameters is typically reduced to a generalized method of moments problem, which involves auxiliary functions that correspond to solutions to a regression or classification problem. Recent line of work on debiased machine learning shows how one can use generic machine learning estimators for these auxiliary problems, while maintaining asymptotic normality and root-$n$ consistency of the target parameter of interest, while only requiring mean-squared-error guarantees from the auxiliary estimation algorithms. The literature typically requires that these auxiliary problems are fitted on a separate sample or in a cross-fitting manner. We show that when these auxiliary estimation algorithms satisfy natural leave-one-out stability properties, then sample splitting is not required. This allows for sample re-use, which can be beneficial in moderately sized sample regimes. For instance, we show that the stability properties that we propose are satisfied for ensemble bagged estimators, built via sub-sampling without replacement, a popular technique in machine learning practice.


title: The Gamma Generalized Normal Distribution: A Descriptor of SAR Imagery

abstract: We propose a new four-parameter distribution for modeling synthetic aperture radar (SAR) imagery named the gamma generalized normal (GGN) by combining the gamma and generalized normal distributions. A mathematical characterization of the new distribution is provided by identifying the limit behavior and by calculating the density and moment expansions. The GGN model performance is evaluated on both synthetic and actual data and, for that, maximum likelihood estimation and random number generation are discussed. The proposed distribution is compared with the beta generalized normal distribution (BGN), which has already shown to appropriately represent SAR imagery. The performance of these two distributions are measured by means of statistics which provide evidence that the GGN can outperform the BGN distribution in some contexts.

categories: stat.ME cs.CV eess.IV math.ST physics.data-an stat.TH


title: A particle system with mean-field interaction: Large-scale limit of stationary distributions

abstract: We consider a system consisting of $n$ particles, moving forward in jumps on the real line. System state is the empirical distribution of particle locations. Each particle ``jumps forward'' at some time points, with the instantaneous rate of jumps given by a decreasing function of the particle's location quantile within the current state (empirical distribution). Previous work on this model established, under certain conditions, the convergence, as $n\to\infty$, of the system random dynamics to that of a deterministic mean-field model (MFM), which is a solution to an integro-differential equation. Another line of previous work established the existence of MFMs that are traveling waves, as well as the attraction of MFM trajectories to traveling waves. The main results of this paper are: (a) We prove that, as $n\to\infty$, the stationary distributions of (re-centered) states concentrate on a (re-centered) traveling wave; (b) We obtain a uniform across $n$ moment bound on the stationary distributions of (re-centered) states; (c) We prove a convergence-to-MFM result, which is substantially more general than that in previous work. Results (b) and (c) serve as ``ingredients'' of the proof of (a), but also are of independent interest.


title: Infrared Plasmons Propagate through a Hyperbolic Nodal Metal

abstract: Metals are canonical plasmonic media at infrared and optical wavelengths, allowing one to guide and manipulate light at the nano-scale. A special form of optical waveguiding is afforded by highly anisotropic crystals revealing the opposite signs of the dielectric functions along orthogonal directions. These media are classified as hyperbolic and include crystalline insulators, semiconductors and artificial metamaterials. Layered anisotropic metals are also anticipated to support hyperbolic waveguiding. Yet this behavior remains elusive, primarily because interband losses arrest the propagation of infrared modes. Here, we report on the observation of propagating hyperbolic waves in a prototypical layered nodal-line semimetal ZrSiSe. The observed waveguiding originates from polaritonic hybridization between near-infrared light and nodal-line plasmons. Unique nodal electronic structures simultaneously suppress interband loss and boost the plasmonic response, ultimately enabling the propagation of infrared modes through the bulk of the crystal.


title: Drawing out of Distribution with Neuro-Symbolic Generative Models

abstract: Learning general-purpose representations from perceptual inputs is a hallmark of human intelligence. For example, people can write out numbers or characters, or even draw doodles, by characterizing these tasks as different instantiations of the same generic underlying process -- compositional arrangements of different forms of pen strokes. Crucially, learning to do one task, say writing, implies reasonable competence at another, say drawing, on account of this shared process. We present Drawing out of Distribution (DooD), a neuro-symbolic generative model of stroke-based drawing that can learn such general-purpose representations. In contrast to prior work, DooD operates directly on images, requires no supervision or expensive test-time inference, and performs unsupervised amortised inference with a symbolic stroke model that better enables both interpretability and generalization. We evaluate DooD on its ability to generalise across both data and tasks. We first perform zero-shot transfer from one dataset (e.g. MNIST) to another (e.g. Quickdraw), across five different datasets, and show that DooD clearly outperforms different baselines. An analysis of the learnt representations further highlights the benefits of adopting a symbolic stroke model. We then adopt a subset of the Omniglot challenge tasks, and evaluate its ability to generate new exemplars (both unconditionally and conditionally), and perform one-shot classification, showing that DooD matches the state of the art. Taken together, we demonstrate that DooD does indeed capture general-purpose representations across both data and task, and takes a further step towards building general and robust concept-learning systems.


title: Direct numerical simulation of thermo-hydro-mechanical processes at Soultz-sous-For\^ets

abstract: Porosity and permeability alteration due to the thermo-poro-elastic stress field disturbance from the cold fluid injection is a deciding factor for longer, economic and safer heat extraction from an enhanced geothermal system (EGS). In the Soultz-sous-For\^ets geothermal system, faulted zones are the main flow paths and the resulting porosity-permeability development over time due to stress reorientation is more sensitive in comparison with the regions without faulted zones. Available operational and field data are combined through a validated numerical simulation model to examine the mechanical impact on the pressure and temperature evolution. Results shows that near the injection wellbore zones, permeability and porosity values are strongly affected by the stress field changes and the permeability changes will affect the overall temperature and pressure of the system demonstrating a fully coupled phenomenon. In some regions inside the faulted zones and close to the injection wellbores, the porosity doubles whereas permeability may enhance up to 30 times. From the sensitivity analysis on the two unknown parameters from the mechanical aspect is performed and results shows that only one of the parameters impacts significantly on the porosity-permeability changes. Further experimental and field works on this parameter will help to model the heat extraction from the Soultz-sous-For\^ets and elsewhere more precisely than before.


title: Spatial Feature Mapping for 6DoF Object Pose Estimation

abstract: This work aims to estimate 6Dof (6D) object pose in background clutter. Considering the strong occlusion and background noise, we propose to utilize the spatial structure for better tackling this challenging task. Observing that the 3D mesh can be naturally abstracted by a graph, we build the graph using 3D points as vertices and mesh connections as edges. We construct the corresponding mapping from 2D image features to 3D points for filling the graph and fusion of the 2D and 3D features. Afterward, a Graph Convolutional Network (GCN) is applied to help the feature exchange among objects' points in 3D space. To address the problem of rotation symmetry ambiguity for objects, a spherical convolution is utilized and the spherical features are combined with the convolutional features that are mapped to the graph. Predefined 3D keypoints are voted and the 6DoF pose is obtained via the fitting optimization. Two scenarios of inference, one with the depth information and the other without it are discussed. Tested on the datasets of YCB-Video and LINEMOD, the experiments demonstrate the effectiveness of our proposed method.


title: Kallima: A Clean-label Framework for Textual Backdoor Attacks

abstract: Although Deep Neural Network (DNN) has led to unprecedented progress in various natural language processing (NLP) tasks, research shows that deep models are extremely vulnerable to backdoor attacks. The existing backdoor attacks mainly inject a small number of poisoned samples into the training dataset with the labels changed to the target one. Such mislabeled samples would raise suspicion upon human inspection, potentially revealing the attack. To improve the stealthiness of textual backdoor attacks, we propose the first clean-label framework Kallima for synthesizing mimesis-style backdoor samples to develop insidious textual backdoor attacks. We modify inputs belonging to the target class with adversarial perturbations, making the model rely more on the backdoor trigger. Our framework is compatible with most existing backdoor triggers. The experimental results on three benchmark datasets demonstrate the effectiveness of the proposed method.


title: Leveraging Heterogeneous Capabilities in Multi-Agent Systems for Environmental Conflict Resolution

abstract: In this paper, we introduce a high-level controller synthesis framework that enables teams of heterogeneous agents to assist each other in resolving environmental conflicts that appear at runtime. This conflict resolution method is built upon temporal-logic-based reactive synthesis to guarantee safety and task completion under specific environment assumptions. In heterogeneous multi-agent systems, every agent is expected to complete its own tasks in service of a global team objective. However, at runtime, an agent may encounter un-modeled obstacles (e.g., doors or walls) that prevent it from achieving its own task. To address this problem, we employ the capabilities of other heterogeneous agents to resolve the obstacle. A controller framework is proposed to redirect agents with the capability of resolving the appropriate obstacles to the required target when such a situation is detected. Three case studies involving a bipedal robot Digit and a quadcopter are used to evaluate the controller performance in action. Additionally, we implement the proposed framework on a physical multi-agent robotic system to demonstrate its viability for real world applications.


title: A holographic bottom-up description of light nuclide spectroscopy and stability

abstract: This work explores a holographic proposal to describe light nuclide spectroscopy by considering extensions to the well-known bottom-up AdS/QCD proposals, the hardwall and softwall models. We also propose an alternative description inspired by the Woods-Saxon potential. We find the static dilaton associated with this potential in this Wood-Saxon-like model. We compute the nuclide spectra finding that, despite their pure AdS/QCD origin, hardwall and softwall, as monoparametric models, have good accuracy and precision since the RMS error is near 11 $\%$ and 4 $\%$ respectively. In the case of the Wood-Saxon model, the RMS was around 1 $\%$. We also discuss configurational entropy as a tool to categorize which model is suitable to describe nuclides in terms of stability. We found that configurational entropy resembles a stability line, independent from nuclear spin, for symmetric light nuclides when considering softwall and Wood-Saxon-like models. For the hardwall case, configurational entropy, despite increasing with the constituent number, depends on the nuclear spin. Thus, the Woods-Saxon-like model emerges as the best choice to describe light nuclide spectroscopy in the bottom-up scenario.


title: Solvability of invariant systems of differential equations on $\mathbb{H}^2$ and beyond

abstract: We show how the Fourier transform for distributional sections of vector bundles over symmetric spaces of non-compact type $G/K$ can be used for questions of solvability of systems of invariant differential equations in analogy to H\"ormander's proof of the Ehrenpreis-Malgrange theorem. We get complete solvability for the hyperbolic plane $\mathbb{H}^2$ and partial results for products $\mathbb{H}^2 \times \cdots \times \mathbb{H}^2$ and the hyperbolic 3-space $\mathbb{H}^3$.


title: Dimension Independent Generalization of DP-SGD for Overparameterized Smooth Convex Optimization

abstract: This paper considers the generalization performance of differentially private convex learning. We demonstrate that the convergence analysis of Langevin algorithms can be used to obtain new generalization bounds with differential privacy guarantees for DP-SGD. More specifically, by using some recently obtained dimension-independent convergence results for stochastic Langevin algorithms with convex objective functions, we obtain $O(n^{-1/4})$ privacy guarantees for DP-SGD with the optimal excess generalization error of $\tilde{O}(n^{-1/2})$ for certain classes of overparameterized smooth convex optimization problems. This improves previous DP-SGD results for such problems that contain explicit dimension dependencies, so that the resulting generalization bounds become unsuitable for overparameterized models used in practical applications.


title: MEGASIM: Lifetimes and Resonances of Earth Trojan Asteroids -- The Death of Primordial ETAs?

abstract: We present an analysis of lifetimes and resonances of Earth Trojan Asteroids (ETAs) in the MEGASIM data set (Yeager & Golovich 2022). Trojan asteroids co-orbit the Sun with a planet but remain bound to the Lagrange points, L4 (60{\deg} leading the planet) or L5 (60{\deg} trailing). In the circular three-body approximation, the stability of a Trojan asteroid depends on the ratio of the host planet mass and the central mass. For the inner planets, the range of stability becomes increasingly small, so perturbations from the planets have made primordial Trojans rare. To date there have been just two ETAs (2010 TK7 and 2020 XL5), several Mars Trojans, and a Venus Trojan discovered. The estimated lifetimes of the known inner system Trojans are less than a million years, suggesting they are interlopers rather than members of a stable and long-lasting population. With the largest ETA n-body simulation to date, we are able to track their survival across a wide initialized parameter space. We find the remaining fraction of ETAs over time is well fit with a stretched exponential function that when extrapolated beyond our simulation run time predicts zero ETAs by 2.33 Gyr. We also show correlations between ETA ejections and the periods of the Milankovitch cycles. Though Earth's orbital dynamics dominate the instabilities of ETAs, we provide evidence that ETA ejections are linked to resonances found in the variation of the orbital elements of many, if not all of the planets.


title: Differentially Private Model Compression

abstract: Recent papers have shown that large pre-trained language models (LLMs) such as BERT, GPT-2 can be fine-tuned on private data to achieve performance comparable to non-private models for many downstream Natural Language Processing (NLP) tasks while simultaneously guaranteeing differential privacy. The inference cost of these models -- which consist of hundreds of millions of parameters -- however, can be prohibitively large. Hence, often in practice, LLMs are compressed before they are deployed in specific applications. In this paper, we initiate the study of differentially private model compression and propose frameworks for achieving 50% sparsity levels while maintaining nearly full performance. We demonstrate these ideas on standard GLUE benchmarks using BERT models, setting benchmarks for future research on this topic.


title: Erosion of cohesive grains by an impinging turbulent jet

abstract: The erosion and transport of particles by an impinging turbulent jet in air is observed in various situations, such as the cleaning of a surface or during the landing of a spacecraft. The presence of inter-particle cohesive forces modifies the erosion threshold, beyond which grains are transported. The cohesion also influences the resulting formation and shape of the crater. In this paper, we characterize the role of the cohesive forces on the erosion of a flat granular bed by an impinging normal turbulent jet in air. We perform experiments using a cohesion-controlled granular material to finely tune the cohesion between particles while keeping the other properties constant. We investigate the effects of the cohesion on the erosion threshold and show that the results can be rationalized by a cohesive Shields number that accounts for the inter-particles cohesion force. Despite the complex nature of a turbulent jet, we can provide a scaling law to correlate the jet erosion threshold, based on the outlet velocity at the nozzle, to a local cohesive Shields number. The presence of cohesion between the grains also modifies the shape of the resulting crater, the transport of grains, and the local erosion process.


title: The Effect of External Debt on Greenhouse Gas Emissions

abstract: We estimate the causal effect of external debt on greenhouse gas emissions in a panel of 78 emerging market and developing economies over the 1990-2015 period. Unlike previous literature, we use external instruments to address the potential endogeneity in the relationship between external debt and greenhouse gas emissions. Specifically, we use international liquidity shocks as instrumental variables for external debt. We find that dealing with the potential endogeneity problem brings about a positive and statistically significant effect of external debt on greenhouse gas emissions: a 1 percentage point (pp.) rise in external debt causes, on average, a 0.5% increase in greenhouse gas emissions. One possible mechanism of action could be that, as external debt increases, governments are less able to enforce environmental regulations because their main priority is to increase the tax base to pay increasing debt services or because they are captured by the private sector who owns that debt and prevented from tightening such regulations.


title: Coffee Roast Intelligence

abstract: As the coffee industry has grown, there would be more demand for roasted coffee beans, as well as increased rivalry for selling coffee and attracting customers. As the flavor of each variety of coffee is dependent on the degree of roasting of the coffee beans, it is vital to maintain a consistent quality related to the degree of roasting. Each barista has their own method for determining the degree of roasting. However, extrinsic circumstances such as light, fatigue, and other factors may alter their judgment. As a result, the quality of the coffee cannot be controlled. The Coffee Roast Intelligence application is a machine learning-based study of roasted coffee bean degrees classification produced as an Android application platform that identifies the color of coffee beans by photographing or uploading them while roasting. This application displays the text showing at what level the coffee beans have been roasted, as well as informs the percent chance of class prediction to the consumers. Users may also keep track of the result of the predictions related to the roasting level of coffee beans.


title: Tidal Tracks and Artificial Disruption of Cold Dark Matter Halos

abstract: We describe a simple extension to existing models for the tidal heating of dark matter subhalos which takes into account second order terms in the impulse approximation for tidal heating. We show that this revised model can accurately match the tidal tracks along which subhalos evolve as measured in high-resolution N-body simulations. We further demonstrate that, when a constant density core is introduced into a subhalo, this model is able to quantitatively reproduce the evolution and artificial disruption of N-body subhalos arising from finite resolution effects. Combining these results we confirm prior work indicating that artificial disruption in N-body simulations can result in a factor two underestimate of the subhalo mass function in the inner regions of host halos, and a 10--20% reduction over the entire virial volume.


title: Visual Clues: Bridging Vision and Language Foundations for Image Paragraph Captioning

abstract: People say, "A picture is worth a thousand words". Then how can we get the rich information out of the image? We argue that by using visual clues to bridge large pretrained vision foundation models and language models, we can do so without any extra cross-modal training. Thanks to the strong zero-shot capability of foundation models, we start by constructing a rich semantic representation of the image (e.g., image tags, object attributes / locations, captions) as a structured textual prompt, called visual clues, using a vision foundation model. Based on visual clues, we use large language model to produce a series of comprehensive descriptions for the visual content, which is then verified by the vision model again to select the candidate that aligns best with the image. We evaluate the quality of generated descriptions by quantitative and qualitative measurement. The results demonstrate the effectiveness of such a structured semantic representation.


title: Some results and problems on clique coverings of hypergraphs

abstract: For a $k$-uniform hypergraph $F$ we consider the parameter $\Theta(F)$, the minimum size of a clique cover of the of $F$. We derive bounds on $\Theta(F)$ for $F$ belonging to various classes of hypergraphs.


title: Machine learning the quantum flux-flux correlation function for catalytic surface reactions

abstract: A dataset of fully quantum flux-flux correlation functions and reaction rate constants was constructed for organic heterogeneous catalytic surface reactions. Gaussian process regressors were successfully fitted to training data to predict previously unseen test set reaction rate constant products and Cauchy fits of the flux-flux correlation function. The optimal regressor prediction mean absolute percent errors were on the order of 0.5% for test set reaction rate constant products and 1.0% for test set flux-flux correlation functions. The Gaussian process regressors were accurate both when looking at kinetics at new temperatures and reactivity of previously unseen reactions and provide a significant speedup respect to the computationally demanding time propagation of the flux-flux correlation function.


title: Ultra-Low-Complexity Algorithms with Structurally Optimal Multi-Group Multicast Beamforming in Large-Scale Systems

abstract: In this work, we propose ultra-low-complexity design solutions for multi-group multicast beamforming in large-scale systems. For the quality-of-service (QoS) problem, by utilizing the optimal multicast beamforming structure obtained recently in [2], we convert the original problem into a non-convex weight optimization problem of a lower dimension and propose two fast first-order algorithms to solve it. Both algorithms are based on successive convex approximation (SCA) and provide fast iterative updates to solve each SCA subproblem. The first algorithm uses a saddle point reformulation in the dual domain and applies the extragradient method with an adaptive step-size procedure to find the saddle point with simple closed-form updates. The second algorithm adopts the alternating direction method of multipliers (ADMM) method by converting each SCA subproblem into a favorable ADMM structure. The structure leads to simple closed-form ADMM updates, where the problem in each update block can be further decomposed into parallel subproblems of small sizes, for which closed-form solutions are obtained. We also propose efficient initialization methods to obtain favorable initial points that facilitate fast convergence. Furthermore, taking advantage of the proposed fast algorithms, for the max-min fair (MMF) problem, we propose a simple closed-form scaling scheme that directly uses the solution obtained from the QoS problem, avoiding the conventional computationally expensive method that iteratively solves the inverse QoS problem. We further develop lower and upper bounds on the performance of this scaling scheme. Simulation results show that the proposed algorithms offer near-optimal performance with substantially lower computational complexity than the state-of-the-art algorithms for large-scale systems.


title: gcd-Pairs in $\mathbb{Z}_{n}$ and their graph representations

abstract: This research introduces a gcd-pair in $\mathbb{Z}_n$ which is an unordered pair $\{[a]_n, [b]_n\}$ of elements in $ \mathbb{Z}_n $ such that $0\leq a,b < n$ and the greatest common divisor $\gcd(a,b)$ divides $ n $. The properties of gcd-pairs in $ \mathbb{Z}_n $ and their graph representations are investigated. We also provide the counting formula of gcd-pairs in $ \mathbb{Z}_n $ and its subsets. The algorithms to find, count and check gcd-pairs in $ \mathbb{Z}_{n}$ are included.


title: Automated Feedback Generation for Competition-Level Code

abstract: Competitive programming has become a popular way for programmers to test their skills. Large-scale online programming contests attract millions of experienced programmers to compete against each other. Competition-level programming problems are challenging in nature, and participants often fail to solve the problem on their first attempt. Some online platforms for competitive programming allow programmers to practice on competition-level problems as well, and the standard feedback for an incorrect practice submission is the first test case that the submission fails. Often, the failed test case does not provide programmers with enough information to resolve the errors in their code, and they abandon the problem after several more unsuccessful attempts. We present Clef, the first data-driven tool that can generate feedback on competition-level code automatically by repairing programmers' incorrect submissions. The key development is that Clef can learn how to generate repairs for incorrect submissions by examining the repairs that other programmers made to their own submissions over time. Since the differences between an incorrect program and a correct program for the same task may be significant, we introduce a new data structure, merge trees, to capture the changes between submissions. Merge trees are versatile: they can encode both large algorithm-level redesigns and small statement-level alterations. Clef applies the patterns it learns from a database of submissions to generate repairs for new submissions outside the database. We evaluated Clef on six real-world problems from Codeforces, the world's largest platform for competitive programming. Clef achieves 42.1% accuracy in repairing programmers' incorrect submissions. Even when given incorrect submissions from programmers who never found the solution to a problem on their own, Clef repairs the users' programs 34.1% of the time.


title: Building a Culture of Equitable Access and Success for Marginalized Members in Today's Particle Physics Community

abstract: Diversity, Equity, Inclusion, and Accessibility (DEIA) are not only called for to ensure morality and justice in our society, they also support ongoing and future excellence in particle physics. Over the past decade, the particle physics community has devised programs to support DEIA along multiple axes, and the way we think about measuring and implementing these initiatives has evolved. DEIA in physics is a broad topic, so in this paper we focus on the experiences of marginalized communities and outline ways different stakeholders can build a culture of equitable access for the success of marginalized individuals. Specifically, we identify urgent needs in the following areas: (1) We need to acquire a better understanding of the status quo, both quantitatively and qualitatively, to assess the effectiveness of existing programs and to develop best practices; (2) we need to develop effective and inclusive ways to engage marginalized communities; (3) we need to create infrastructure to better support members of marginalized communities, on an academic, financial and personal level; (4) we need to create an environment conducive to equitable access and success by establishing community expectations, fostering inclusion in social interactions, and holding individuals and institutions accountable; and (5) we need to establish a mechanism to monitor progress in the area of DEIA, including the implementation of the recommendations enumerated in this paper and others during the Snowmass 2021 process.

categories: physics.soc-ph hep-ex hep-ph hep-th physics.ed-ph


title: Universal growth scaling law determined by dimensionality

abstract: Growth patterns of complex systems predict how they change in sizes, numbers, masses, etc. Understanding growth is important, especially for many biological, ecological, urban, and socioeconomic systems. One noteworthy growth behavior is the 3/4- or and 2/3-power scaling law. It's observed in worldwide aquatic and land biomass productions, eukaryote growth, mammalian brain sizes, and city public facility distributions. Here, I show that these complex systems belong to a new universality class whose system dimensionality determines its growth scaling. The model uses producer-consumer dynamics to derive the n/(n+1) power scaling law for an n-dimensional system. Its predictions are validated with real-world two- and three-dimensional data. Dimensionality analysis thus provides a new paradigm for understanding growth and growth-related problems in a wide range of complex systems.


title: Out-of-Distribution Detection using BiGAN and MDL

abstract: We consider the following problem: we have a large dataset of normal data available. We are now given a new, possibly quite small, set of data, and we are to decide if these are normal data, or if they are indicating a new phenomenon. This is a novelty detection or out-of-distribution detection problem. An example is in medicine, where the normal data is for people with no known disease, and the new dataset people with symptoms. Other examples could be in security. We solve this problem by training a bidirectional generative adversarial network (BiGAN) on the normal data and using a Gaussian graphical model to model the output. We then use universal source coding, or minimum description length (MDL) on the output to decide if it is a new distribution, in an implementation of Kolmogorov and Martin-L\"{o}f randomness. We apply the methodology to both MNIST data and a real-world electrocardiogram (ECG) dataset of healthy and patients with Kawasaki disease, and show better performance in terms of the ROC curve than similar methods.


title: Evaluating the V-band Photometric Metallicity with Fundamental Mode RR Lyrae in the Kepler Field

abstract: The aim of this work is to evaluate the performance of photometric metallicity [Fe/H], determined based on V-band light-curves photometrically transformed from the gr-band light-curves. We tested this by using a set of homogeneous sample of fundamental mode RR Lyrae located in the Kepler field. It was found that the color-term is necessary in such photometric transformation. We demonstrated that including the color-term the determined photometric [Fe/H] are in good agreement to the spectroscopic [Fe/H], either based on the calibrated or the transformed V-band light-curves. We also tested the impact of Blazhko RR Lyrae in determining the photometric Fe/H], and found that Blazhko RR Lyrae can give consistent photometric [Fe/H]. Finally, we derived independent gVr-band [Fe/H]-$\phi_{31}$-P relations (where $\phi_{31}$ and P are Fourier parameter and pulsation period, respectively) using our light-curves. The V-band relation is in good agreement with the most recent determination given in the literature.


title: Practical and powerful kernel-based change-point detection

abstract: Change-point analysis plays a significant role in various fields to reveal discrepancies in distribution in a sequence of observations. While a number of algorithms have been proposed for high-dimensional data, kernel-based methods have not been well explored due to difficulties in controlling false discoveries and mediocre performance. In this paper, we propose a new kernel-based framework that makes use of an important pattern of data in high dimensions to boost power. Analytic approximations to the significance of the new statistics are derived and fast tests based on the asymptotic results are proposed, offering easy off-the-shelf tools for large datasets. The new tests show superior performance for a wide range of alternatives when compared with other state-of-the-art methods. We illustrate these new approaches through an analysis of a phone-call network data. All proposed methods are implemented in an R package KerSeg.


title: Semi-vortices and cluster-vorticity: new concepts in the Berezinskii-Kosterlitz-Thouless phase transition

abstract: The Berezinskii-Kosterlitz-Thouless (BKT) essential phase transition in the 2d XY model is revisited. Its mechanism is usually described by the (un)binding of vortex--anti-vortex (V--AV) pairs, which does, however, not provide a clear-cut quantitative criterion for criticality. Known sharp criteria are the divergence of the correlation length and a discontinuity of the helicity modulus. Here we propose and probe a new criterion: it is based on the concepts of semi-vortices and cluster vorticity, which are formulated in the framework of the multi-cluster algorithm that we use to simulate the 2d XY model.


title: A possible surviving companion of the SN Ia in the Galactic SNR G272.2-3.2

abstract: We use the {\it Gaia} EDR3 to explore the Galactic supernova remnant SNR G272.2-3.2, produced by the explosion of a Type Ia supernova (SNIa), about 7,500 years ago, to search for a surviving companion. From the abundances in the SNR ejecta, G272.2-3.2 is a normal SN Ia. The {\it Gaia} parallaxes allow to select the stars located within the estimated distance range of the SNR, and the {\it Gaia} proper motions to study their kinematics. From the {\it Gaia} EDR3 photometry, we construct the HR diagram of the selected sample, which we compare with the theoretical predictions for the evolution of possible star companions of SNIa. We can discard several proposed types of companions by combining kinematics and photometry. We can also discard hypervelocity stars. We focus our study on the kinematically most peculiar star, {\it Gaia} EDR3 5323900215411075328 (hereafter MV-G272), a 8.9 $\sigma$ outlier in proper motion. It is of M1-M2 stellar type. Its trajectory on the sky locates it at the center of the SNR, 6,000--8,000 years ago, a unique characteristic among the the sample. Spectra allow a stellar parameters determination and a chemical abundance analysis. In conclusion, we have a candidate to be the surviving companion of the SN Ia that resulted in SNR G272.2-3.2. It is supported by its kinematical characteristics and its trajectory within the SNR. This opens the possibility of a single-degenerate scenario for a SN Ia with an M-type dwarf companion.


title: Poisson2Sparse: Self-Supervised Poisson Denoising From a Single Image

abstract: Image enhancement approaches often assume that the noise is signal independent, and approximate the degradation model as zero-mean additive Gaussian. However, this assumption does not hold for biomedical imaging systems where sensor-based sources of noise are proportional to signal strengths, and the noise is better represented as a Poisson process. In this work, we explore a sparsity and dictionary learning-based approach and present a novel self-supervised learning method for single-image denoising where the noise is approximated as a Poisson process, requiring no clean ground-truth data. Specifically, we approximate traditional iterative optimization algorithms for image denoising with a recurrent neural network that enforces sparsity with respect to the weights of the network. Since the sparse representations are based on the underlying image, it is able to suppress the spurious components (noise) in the image patches, thereby introducing implicit regularization for denoising tasks through the network structure. Experiments on two bio-imaging datasets demonstrate that our method outperforms the state-of-the-art approaches in terms of PSNR and SSIM. Our qualitative results demonstrate that, in addition to higher performance on standard quantitative metrics, we are able to recover much more subtle details than other compared approaches. Our code is made publicly available at https://github.com/tacalvin/Poisson2Sparse


title: Design and Implementation of an Heuristic-Enhanced Branch-and-Bound Solver for MILP

abstract: We present a solver for Mixed Integer Programs (MIP) developed for the MIP competition 2022. Given the 10 minutes bound on the computational time established by the rules of the competition, our method focuses on finding a feasible solution and improves it through a Branch-and-Bound algorithm. Another rule of the competition allows the use of up to 8 threads. Each thread is given a different primal heuristic, which has been tuned by hyper-parameters, to find a feasible solution. In every thread, once a feasible solution is found, we stop and we use a Branch-and-Bound method, embedded with local search heuristics, to ameliorate the incumbent solution. The three variants of the Diving heuristic that we implemented manage to find a feasible solution for 10 instances of the training data set. These heuristics are the best performing among the heuristics that we implemented. Our Branch-and-Bound algorithm is effective on a small portion of the training data set, and it manages to find an incumbent feasible solution for an instance that we could not solve with the Diving heuristics. Overall, our combined methods, when implemented with extensive computational power, can solve 11 of the 19 problems of the training data set within the time limit. Our submission to the MIP competition was awarded the "Outstanding Student Submission" honorable mention.


title: Efficient Manipulation of Bose-Einstein Condensates in a Double-Well Potential

abstract: We pose the problem of transferring a Bose-Einstein Condensate (BEC) from one side of a double-well potential to the other as an optimal control problem for determining the time-dependent form of the potential. We derive a reduced dynamical system using a Galerkin truncation onto a finite set of eigenfunctions and find that including three modes suffices to effectively control the full dynamics, described by the Gross-Pitaevskii model of BEC. The functional form of the control is reduced to finite dimensions by using another Galerkin-type method called the chopped random basis (CRAB) method, which is then optimized by a genetic algorithm called differential evolution (DE). Finally, we discuss the extent to which the reduction-based optimal control strategy can be refined by means of including more modes in the Galerkin reduction.


title: Extreme Compression for Pre-trained Transformers Made Simple and Efficient

abstract: Extreme compression, particularly ultra-low bit precision (binary/ternary) quantization, has been proposed to fit large NLP models on resource-constraint devices. However, to preserve the accuracy for such aggressive compression schemes, cutting-edge methods usually introduce complicated compression pipelines, e.g., multi-stage expensive knowledge distillation with extensive hyperparameter tuning. Also, they oftentimes focus less on smaller transformer models that have already been heavily compressed via knowledge distillation and lack a systematic study to show the effectiveness of their methods. In this paper, we perform a very comprehensive systematic study to measure the impact of many key hyperparameters and training strategies from previous works. As a result, we find out that previous baselines for ultra-low bit precision quantization are significantly under-trained. Based on our study, we propose a simple yet effective compression pipeline for extreme compression, named XTC. XTC demonstrates that (1) we can skip the pre-training knowledge distillation to obtain a 5-layer BERT while achieving better performance than previous state-of-the-art methods, e.g., the 6-layer TinyBERT; (2) extreme quantization plus layer reduction is able to reduce the model size by 50x, resulting in new state-of-the-art results on GLUE tasks.


title: On Supervised On-line Rolling-Horizon Control for Infinite-Horizon Discounted Markov Decision Processes

abstract: This note re-visits the rolling-horizon control approach to the problem of a Markov decision process (MDP) with infinite-horizon discounted expected reward criterion. Distinguished from the classical value-iteration approach, we develop an asynchronous on-line algorithm based on policy iteration integrated with a multi-policy improvement method of policy switching. A sequence of monotonically improving solutions to the forecast-horizon sub-MDP is generated by updating the current solution only at the currently visited state, building in effect a rolling-horizon control policy for the MDP over infinite horizon. Feedbacks from "supervisors," if available, can be also incorporated while updating. We focus on the convergence issue with a relation to the transition structure of the MDP. Either a global convergence to an optimal forecast-horizon policy or a local convergence to a "locally-optimal" fixed-policy in a finite time is achieved by the algorithm depending on the structure.


title: ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers

abstract: How to efficiently serve ever-larger trained natural language models in practice has become exceptionally challenging even for powerful cloud servers due to their prohibitive memory/computation requirements. In this work, we present an efficient and affordable post-training quantization approach to compress large Transformer-based models, termed as ZeroQuant. ZeroQuant is an end-to-end quantization and inference pipeline with three main components: (1) a fine-grained hardware-friendly quantization scheme for both weight and activations; (2) a novel affordable layer-by-layer knowledge distillation algorithm (LKD) even without the access to the original training data; (3) a highly-optimized quantization system backend support to remove the quantization/dequantization overhead. As such, we are able to show that: (1) ZeroQuant can reduce the precision for weights and activations to INT8 in a cost-free way for both BERT and GPT3-style models with minimal accuracy impact, which leads to up to 5.19x/4.16x speedup on those models compared to FP16 inference; (2) ZeroQuant plus LKD affordably quantize the weights in the fully-connected module to INT4 along with INT8 weights in the attention module and INT8 activations, resulting in 3x memory footprint reduction compared to the FP16 model; (3) ZeroQuant can be directly applied to two of the largest open-sourced language models, including GPT-J6B and GPT-NeoX20, for which our INT8 model achieves similar accuracy as the FP16 model but achieves up to 5.2x better efficiency.


title: Image Data collection and implementation of deep learning-based model in detecting Monkeypox disease using modified VGG16

abstract: While the world is still attempting to recover from the damage caused by the broad spread of COVID-19, the Monkeypox virus poses a new threat of becoming a global pandemic. Although the Monkeypox virus itself is not deadly and contagious as COVID-19, still every day, new patients case has been reported from many nations. Therefore, it will be no surprise if the world ever faces another global pandemic due to the lack of proper precautious steps. Recently, Machine learning (ML) has demonstrated huge potential in image-based diagnoses such as cancer detection, tumor cell identification, and COVID-19 patient detection. Therefore, a similar application can be adopted to diagnose the Monkeypox-related disease as it infected the human skin, which image can be acquired and further used in diagnosing the disease. Considering this opportunity, in this work, we introduce a newly developed "Monkeypox2022" dataset that is publicly available to use and can be obtained from our shared GitHub repository. The dataset is created by collecting images from multiple open-source and online portals that do not impose any restrictions on use, even for commercial purposes, hence giving a safer path to use and disseminate such data when constructing and deploying any type of ML model. Further, we propose and evaluate a modified VGG16 model, which includes two distinct studies: Study One and Two. Our exploratory computational results indicate that our suggested model can identify Monkeypox patients with an accuracy of $97\pm1.8\%$ (AUC=97.2) and $88\pm0.8\%$ (AUC=0.867) for Study One and Two, respectively. Additionally, we explain our model's prediction and feature extraction utilizing Local Interpretable Model-Agnostic Explanations (LIME) help to a deeper insight into specific features that characterize the onset of the Monkeypox virus.


title: Recursive Deformable Image Registration Network with Mutual Attention

abstract: Deformable image registration, estimating the spatial transformation between different images, is an important task in medical imaging. Many previous studies have used learning-based methods for multi-stage registration to perform 3D image registration to improve performance. The performance of the multi-stage approach, however, is limited by the size of the receptive field where complex motion does not occur at a single spatial scale. We propose a new registration network combining recursive network architecture and mutual attention mechanism to overcome these limitations. Compared with the state-of-the-art deep learning methods, our network based on the recursive structure achieves the highest accuracy in lung Computed Tomography (CT) data set (Dice score of 92\% and average surface distance of 3.8mm for lungs) and one of the most accurate results in abdominal CT data set with 9 organs of various sizes (Dice score of 55\% and average surface distance of 7.8mm). We also showed that adding 3 recursive networks is sufficient to achieve the state-of-the-art results without a significant increase in the inference time.


title: Model-Informed Generative Adversarial Network (MI-GAN) for Learning Optimal Power Flow

abstract: The optimal power flow (OPF) problem, as a critical component of power system operations, becomes increasingly difficult to solve due to the variability, intermittency, and unpredictability of renewable energy brought to the power system. Although traditional optimization techniques, such as stochastic and robust optimization approaches, could be leveraged to address the OPF problem, in the face of renewable energy uncertainty, i.e., the dynamic coefficients in the optimization model, their effectiveness in dealing with large-scale problems remains limited. As a result, deep learning techniques, such as neural networks, have recently been developed to improve computational efficiency in solving OPF problems with the utilization of data. However, the feasibility and optimality of the solution may not be guaranteed, and the system dynamics cannot be properly addressed as well. In this paper, we propose an optimization model-informed generative adversarial network (MI-GAN) framework to solve OPF under uncertainty. The main contributions are summarized into three aspects: (1) to ensure feasibility and improve optimality of generated solutions, three important layers are proposed: feasibility filter layer, comparison layer, and gradient-guided layer; (2) in the GAN-based framework, an efficient model-informed selector incorporating these three new layers is established; and (3) a new recursive iteration algorithm is also proposed to improve solution optimality and handle the system dynamics. The numerical results on IEEE test systems show that the proposed method is very effective and promising.


title: Quantum Fluctuations, The Casimir Effect and The Historical Burden

abstract: It has been argued since 1948, when it was experimentally demonstrated, that the Casimir effect-where two non-charged conducting plates have a weak but measurable force on each other dependent on the inverse fourth power of the distance between them-shows the reality of vacuum zero-point fluctuations. This "proof" of the reality of vacuum fluctuations has been repeated in many quantum field theory books and papers subsequent to 1948. The attractive force is generally ascribed to the difference in zero-point energy of the electromagnetic field between the plates and the vacuum external to them. As is well known, zero-point vacuum fluctuations are incompatible with relativistic physics and are at the root of the "cosmological constant" problem. Most texts on quantum mechanics and quantum field theory eliminate the vacuum energy by normal ordering or some other mechanism. These issues are explored in this paper and it is pointed out that a means to resolve them already exists.


title: Robust and Kernelized Data-Enabled Predictive Control for Nonlinear Systems

abstract: This paper presents a robust and kernelized data-enabled predictive control (RoKDeePC) algorithm to perform model-free optimal control for nonlinear systems using only input and output data. The algorithm combines robust predictive control and a non-parametric representation of nonlinear systems enabled by regularized kernel methods. The latter is based on implicitly learning the nonlinear behavior of the system via the representer theorem. Instead of seeking a model and then performing control design, our method goes directly from data to control. This allows us to robustify the control inputs against the uncertainties in data by considering a min-max optimization problem to calculate the optimal control sequence. We show that by incorporating a proper uncertainty set, this min-max problem can be reformulated as a nonconvex but structured minimization problem. By exploiting its structure, we present a projected gradient descent algorithm to effectively solve this problem. Finally, we test the RoKDeePC on two nonlinear example systems - one academic case study and a grid-forming converter feeding a nonlinear load - and compare it with some existing nonlinear data-driven predictive control methods.


title: SPGNet: Spatial Projection Guided 3D Human Pose Estimation in Low Dimensional Space

abstract: We propose a method SPGNet for 3D human pose estimation that mixes multi-dimensional re-projection into supervised learning. In this method, the 2D-to-3D-lifting network predicts the global position and coordinates of the 3D human pose. Then, we re-project the estimated 3D pose back to the 2D key points along with spatial adjustments. The loss functions compare the estimated 3D pose with the 3D pose ground truth, and re-projected 2D pose with the input 2D pose. In addition, we propose a kinematic constraint to restrict the predicted target with constant human bone length. Based on the estimation results for the dataset Human3.6M, our approach outperforms many state-of-the-art methods both qualitatively and quantitatively.


title: Existence and boundary behaviour of radial solutions for weighted elliptic systems with gradient terms

abstract: We are concerned with the existence and boundary behaviour of positive radial solutions for the system \begin{equation*} \left\{ \begin{aligned} \Delta u&=|x|^{a}v^{p} &&\quad\mbox{ in } \Omega, \\ \Delta v&=|x|^{b}v^{q}f(|\nabla u|) &&\quad\mbox{ in } \Omega, \end{aligned} \right. \end{equation*} where $\Omega \subset \bR^N$ is either a ball centered at the origin or the whole space $\bR^N$, $a$, $b$, $p$, $q> 0$, and $f \in C^1[0, \infty)$ is an increasing function such that $f(t)> 0$ for all $t> 0$. Firstly, we study the existence of positive radial solutions in case when the system is posed in a ball corresponding to their behaviour at the boundary. Next, we take $f(t) = t^s$, $s> 1$, $\Omega = \bR^N$ and by the use of dynamical system techniques we are able to describe the behaviour at infinity for such positive radial solutions.


title: Multiple-scattering frequency-time hybrid solver for the wave equation in interior domains

abstract: This paper proposes a frequency-time hybrid solver for the time-dependent wave equation in two-dimensional interior spatial domains. The approach relies on four main elements, namely, 1) A multiple scattering strategy that decomposes a given interior time-domain problem into a sequence of limited-duration time-domain problems of scattering by overlapping open arcs, each one of which is reduced (by means of the Fourier transform) to a sequence of Helmholtz frequency-domain problems; 2) Boundary integral equations on overlapping boundary patches for the solution of the frequency-domain problems in point 1); 3) A smooth "Time-windowing and recentering" methodology that enables both treatment of incident signals of long duration and long time simulation; and, 4) A Fourier transform algorithm that delivers numerically dispersionless, spectrally-accurate time evolution for given incident fields. By recasting the interior time-domain problem in terms of a sequence of open-arc multiple scattering events, the proposed approach regularizes the full interior frequency domain problem-which, if obtained by either Fourier or Laplace transformation of the corresponding interior time-domain problem, must encapsulate infinitely many scattering events, giving rise to non-uniqueness and eigenfunctions in the Fourier case, and ill conditioning in the Laplace case. Numerical examples are included which demonstrate the accuracy and efficiency of the proposed methodology.


title: Dilute polymer solutions under shear flow: comprehensive qualitative analysis using a bead-spring chain model with a FENE-Fraenkel spring

abstract: Although the non-equilibrium behaviour of polymer solutions is generally well understood, particularly in extensional flow, there remain several unanswered questions for dilute solutions in simple shear flow, and full quantitative agreement with experiments has not been achieved. For example, experimental viscosity data exhibit qualitative differences in shear-thinning exponents, shear rate for onset of shear-thinning and high-shear Newtonian plateaus depending on polymer semiflexibility, contour length and solvent quality. While polymer models are able to incorporate all of these effects through various spring force laws, bending potentials, excluded volume (EV) potentials, and hydrodynamic interaction (HI), the inclusion of each piece of physics has not been systematically matched to experimentally observed behaviour. Furthermore, attempts to develop multiscale models (in the sense of representing an arbitrarily small or large polymer chain) which can make quantitative predictions are hindered by the lack of ability to fully match the results of bead-rod models, often used to represent a polymer chain at the Kuhn step level, with bead-spring models, which take into account the entropic elasticity.In light of these difficulties, this work aims to develop a general model based on the so-called FENE-Fraenkel spring, originally formulated by Larson and coworkers [J. Chem. Phys. 124 (2006), 10.1063/1.2161210], which can span the range from rigid rod to traditional entropic spring, as well as include a bending potential, EV and HI. As we show, this model can reproduce, and smoothly move between, a wide range of previously observed polymer solution rheology in shear flow.


title: Estimating the Effect of Team Hitting Strategies Using Counterfactual Virtual Simulation in Baseball

abstract: In baseball, every play on the field is quantitatively evaluated and has an effect on individual and team strategies. The weighted on base average (wOBA) is well known as a measure of an batter's hitting contribution. However, this measure ignores the game situation, such as the runners on base, which coaches and batters are known to consider when employing multiple hitting strategies, yet, the effectiveness of these strategies is unknown. This is probably because (1) we cannot obtain the batter's strategy and (2) it is difficult to estimate the effect of the strategies. Here, we propose a new method for estimating the effect using counterfactual batting simulation. To this end, we propose a deep learning model that transforms batting ability when batting strategy is changed. This method can estimate the effects of various strategies, which has been traditionally difficult with actual game data. We found that, when the switching cost of batting strategies can be ignored, the use of different strategies increased runs. When the switching cost is considered, the conditions for increasing runs were limited. Our validation results suggest that our simulation could clarify the effect of using multiple batting strategies.


title: Affine Symplectic Grassmann codes

abstract: In this manuscript, we introduce a new class of linear codes, called affine symplectic Grassmann codes, and determine their parameters, automorphism group, minimum distance codewords, dual code and other key features. These linear codes are defined from an affine part of a polar symplectic Grassmannian. They combine polar symplectic Grassmann codes and affine Grassmann codes.


title: Missing data imputation for a multivariate outcome of mixed variable types

abstract: Data collected in clinical trials are often composed of multiple types of variables. For example, laboratory measurements and vital signs are longitudinal data of continuous or categorical variables, adverse events may be recurrent events, and death is a time-to-event variable. Missing data due to patients' discontinuation from the study or as a result of handling intercurrent events using a hypothetical strategy almost always occur during any clinical trial. Imputing these data with mixed types of variables simultaneously is a challenge that has not been studied extensively. In this article, we propose using an approximate fully conditional specification to impute the missing data. Simulation shows the proposed method provides satisfactory results under the assumption of missing at random. Finally, real data from a clinical trial evaluating treatments for diabetes are analyzed to illustrate the potential benefit of the proposed method.


title: An Unpooling Layer for Graph Generation

abstract: We propose a novel and trainable graph unpooling layer for effective graph generation. Given a graph with features, the unpooling layer enlarges this graph and learns its desired new structure and features. Since this unpooling layer is trainable, it can be applied to graph generation either in the decoder of a variational autoencoder or in the generator of a generative adversarial network (GAN). We prove that the unpooled graph remains connected and any connected graph can be sequentially unpooled from a 3-nodes graph. We apply the unpooling layer within the GAN generator. Since the most studied instance of graph generation is molecular generation, we test our ideas in this context. Using the QM9 and ZINC datasets, we demonstrate the improvement obtained by using the unpooling layer instead of an adjacency-matrix-based approach.


title: Prospective Preference Enhanced Mixed Attentive Model for Session-based Recommendation

abstract: Session-based recommendation aims to generate recommendations for the next item of users' interest based on a given session. In this manuscript, we develop prospective preference enhanced mixed attentive model (P2MAM) to generate session-based recommendations using two important factors: temporal patterns and estimates of users' prospective preferences. Unlike existing methods, P2MAM models the temporal patterns using a light-weight while effective position-sensitive attention mechanism. In P2MAM, we also leverage the estimate of users' prospective preferences to signify important items, and generate better recommendations. Our experimental results demonstrate that P2MAM models significantly outperform the state-of-the-art methods in six benchmark datasets, with an improvement as much as 19.2%. In addition, our run-time performance comparison demonstrates that during testing, P2MAM models are much more efficient than the best baseline method, with a significant average speedup of 47.7 folds.


title: A modularized algorithmic framework for interface related optimization problems using characteristic functions

abstract: In this paper, we consider the algorithms and convergence for a general optimization problem, which has a wide range of applications in image segmentation, topology optimization, flow network formulation, and surface reconstruction. In particular, the problem focuses on interface related optimization problems where the interface is implicitly described by characteristic functions of the corresponding domains. Under such representation and discretization, the problem is then formulated into a discretized optimization problem where the objective function is concave with respect to characteristic functions and convex with respect to state variables. We show that under such structure, the iterative scheme based on alternative minimization can converge to a local minimizer. Extensive numerical examples are performed to support the theory.


title: Voyager 3: A Concept Mission to Interstellar Medium

abstract: Voyager 3 is a concept mission that sends a space telescope to the interstellar medium in a reasonable amount of time. Voyager 3 would take a direct image of an exoplanet using the solar gravitational lensing at the distance of 550 astronomical unit (AU). The spacecraft would use its suite of scientific instruments to study the environment of the local solar system and interstellar medium and finalize its primary mission by imaging an exoplanet. Two potential architectures are proposed to meet this mission directive, using multiple gravitational assists and sizable electric propulsion burns to achieve the high escape speeds necessary to reach 550 AU. This paper expands on the science mission objectives, trajectory, and the preliminary design of the baseline spacecraft.


title: Remote Collaboration Fuses Fewer Breakthrough Ideas

abstract: Theories of innovation emphasize the role of social networks and teams as facilitators of breakthrough discoveries. Around the world, scientists and inventors today are more plentiful and interconnected than ever before. But while there are more people making discoveries, and more ideas that can be reconfigured in novel ways, research suggests that new ideas are getting harder to find-contradicting recombinant growth theory. In this paper, we shed new light on this apparent puzzle. Analyzing 20 million research articles and 4 million patent applications across the globe over the past half-century, we begin by documenting the rise of remote collaboration across cities, underlining the growing interconnectedness of scientists and inventors globally. We further show that across all fields, periods, and team sizes, researchers in these remote teams are consistently less likely to make breakthrough discoveries relative to their onsite counterparts. Creating a dataset that allows us to explore the division of labor in knowledge production within teams and across space, we find that among distributed team members, collaboration centers on late-stage, technical tasks involving more codified knowledge. Yet they are less likely to join forces in conceptual tasks-such as conceiving new ideas and designing research-when knowledge is tacit. We conclude that despite striking improvements in digital technology in recent years, remote teams are less likely to integrate the knowledge of their members to produce new, disruptive ideas.


title: Estimating Dust Temperature and Far-IR Luminosity of High-Redshift Galaxies using ALMA Single-Band Continuum Observations

abstract: We present a method that derives the dust temperatures and infrared (IR) luminosities of high-redshift galaxies assuming radiation equilibrium in a simple dust and stellar distribution geometry. Using public data from the Atacama Large Millimeter/submillimeter Array (ALMA) archive, we studied dust temperatures assuming a clumpy interstellar medium (ISM) model for high-redshift galaxies, then tested the consistency of our results with those obtained using other methods. We find that a dust distribution model assuming a clumpiness of ${\rm log}\,\xi_{\rm clp}=-1.02\pm0.41$ may accurately represent the ISM of high-redshift star-forming galaxies. By assuming a value of $\xi_{\rm{clp}}$, our method enables the derivation of dust temperatures and IR luminosities of high-redshift galaxies from dust continuum fluxes and emission sizes obtained from single-band ALMA observations. to demonstrate the method proposed herein, we determined the dust temperature ($T_{\rm d}=95^{+13}_{-17}\,\rm{K}$) of a $z\sim8.3$ star-forming galaxy, MACS0416-Y1. Because the method only requires a single-band dust observation to derive a dust temperature, it is more easily accessible than multi-band observations or high-redshift emission line searches and can be applied to large samples of galaxies in future studies using high resolution interferometers such as ALMA.


title: Learning in Congestion Games with Bandit Feedback

abstract: In this paper, we investigate Nash-regret minimization in congestion games, a class of games with benign theoretical structure and broad real-world applications. We first propose a centralized algorithm based on the optimism in the face of uncertainty principle for congestion games with (semi-)bandit feedback, and obtain finite-sample guarantees. Then we propose a decentralized algorithm via a novel combination of the Frank-Wolfe method and G-optimal design. By exploiting the structure of the congestion game, we show the sample complexity of both algorithms depends only polynomially on the number of players and the number of facilities, but not the size of the action set, which can be exponentially large in terms of the number of facilities. We further define a new problem class, Markov congestion games, which allows us to model the non-stationarity in congestion games. We propose a centralized algorithm for Markov congestion games, whose sample complexity again has only polynomial dependence on all relevant problem parameters, but not the size of the action set.


title: Face Recognition Accuracy Across Demographics: Shining a Light Into the Problem

abstract: We explore varying face recognition accuracy across demographic groups as a phenomenon partly caused by differences in face illumination. We observe that for a common operational scenario with controlled image acquisition, there is a large difference in face region brightness between African-American and Caucasian, and also a smaller difference between male and female. We show that impostor image pairs with both faces under-exposed, or both overexposed, have an increased false match rate (FMR). Conversely, image pairs with strongly different face brightness have a decreased similarity measure. We propose a brightness information metric to measure variation in brightness in the face and show that face brightness that is too low or too high has reduced information in the face region, providing a cause for the lower accuracy. Based on this, for operational scenarios with controlled image acquisition, illumination should be adjusted for each individual to obtain appropriate face image brightness. This is the first work that we are aware of to explore how the level of brightness of the skin region in a pair of face images (rather than a single image) impacts face recognition accuracy, and to evaluate this as a systematic factor causing unequal accuracy across demographics. The code is at https://github.com/HaiyuWu/FaceBrightness.


title: Study of Robust Adaptive Power Allocation Techniques for Rate Splitting based MU-MIMO systems

abstract: Rate splitting (RS) systems can better deal with imperfect channel state information at the transmitter (CSIT) than conventional approaches. However, this requires an appropriate power allocation that often has a high computational complexity, which might be inadequate for practical and large systems. To this end, adaptive power allocation techniques can provide good performance with low computational cost. This work presents novel robust and adaptive power allocation technique for RS-based multiuser multiple-input multiple-output (MU-MIMO) systems. In particular, we develop a robust adaptive power allocation based on stochastic gradient learning and the minimization of the mean-square error between the transmitted symbols of the RS system and the received signal. The proposed robust power allocation strategy incorporates knowledge of the variance of the channel errors to deal with imperfect CSIT and adjust power levels in the presence of uncertainty. An analysis of the convexity and stability of the proposed power allocation algorithms is provided, together with a study of their computational complexity and theoretical bounds relating the power allocation strategies. Numerical results show that the sum-rate of an RS system with adaptive power allocation outperforms RS and conventional MU-MIMO systems under imperfect CSIT. %\vspace{-0.75em}


title: A symmetrized parametric finite element method for anisotropic surface diffusion in 3D

abstract: For the evolution of a closed surface under anisotropic surface diffusion with a general anisotropic surface energy $\gamma(\boldsymbol{n})$ in three dimensions (3D), where $\boldsymbol{n}$ is the unit outward normal vector, by introducing a novel symmetric positive definite surface energy matrix $\boldsymbol{Z}_k(\boldsymbol{n})$ depending on a stabilizing function $k(\boldsymbol{n})$ and the Cahn-Hoffman $\boldsymbol{\xi}$-vector, we present a new symmetrized variational formulation for anisotropic surface diffusion with weakly or strongly anisotropic surface energy, which preserves two important structures including volume conservation and energy dissipation. Then we propose a structural-preserving parametric finite element method (SP-PFEM) to discretize the symmetrized variational problem, which preserves the volume in the discretized level. Under a relatively mild and simple condition on $\gamma(\boldsymbol{n})$, we show that SP-PFEM is unconditionally energy-stable for almost all anisotropic surface energies $\gamma(\boldsymbol{n})$ arising in practical applications. Extensive numerical results are reported to demonstrate the efficiency and accuracy as well as energy dissipation of the proposed SP-PFEM for solving anisotropic surface diffusion in 3D.


title: A Superimposed Divide-and-Conquer Image Recognition Method for SEM Images of Nanoparticles on The Surface of Monocrystalline silicon with High Aggregation Degree

abstract: The nanoparticle size and distribution information in the SEM images of silicon crystals are generally counted by manual methods. The realization of automatic machine recognition is significant in materials science. This paper proposed a superposition partitioning image recognition method to realize automatic recognition and information statistics of silicon crystal nanoparticle SEM images. Especially for the complex and highly aggregated characteristics of silicon crystal particle size, an accurate recognition step and contour statistics method based on morphological processing are given. This method has technical reference value for the recognition of Monocrystalline silicon surface nanoparticle images under different SEM shooting conditions. Besides, it outperforms other methods in terms of recognition accuracy and algorithm efficiency.


title: Data-driven Construction of Hierarchical Matrices with Nested Bases

abstract: Hierarchical matrices provide a powerful representation for significantly reducing the computational complexity associated with dense kernel matrices. For general kernel functions, interpolation-based methods are widely used for the efficient construction of hierarchical matrices. In this paper, we present a fast hierarchical data reduction (HiDR) procedure with $O(n)$ complexity for the memory-efficient construction of hierarchical matrices with nested bases where $n$ is the number of data points. HiDR aims to reduce the given data in a hierarchical way so as to obtain $O(1)$ representations for all nearfield and farfield interactions. Based on HiDR, a linear complexity $\mathcal{H}^2$ matrix construction algorithm is proposed. The use of data-driven methods enables {better efficiency than other general-purpose methods} and flexible computation without accessing the kernel function. Experiments demonstrate significantly improved memory efficiency of the proposed data-driven method compared to interpolation-based methods over a wide range of kernels. Though the method is not optimized for any special kernel, benchmark experiments for the Coulomb kernel show that the proposed general-purpose algorithm offers competitive performance for hierarchical matrix construction compared to several state-of-the-art algorithms for the Coulomb kernel.