title: Applying Semi-Automated Hyperparameter Tuning for Clustering Algorithms

abstract: When approaching a clustering problem, choosing the right clustering algorithm and parameters is essential, as each clustering algorithm is proficient at finding clusters of a particular nature. Due to the unsupervised nature of clustering algorithms, there are no ground truth values available for empirical evaluation, which makes automation of the parameter selection process through hyperparameter tuning difficult. Previous approaches to hyperparameter tuning for clustering algorithms have relied on internal metrics, which are often biased towards certain algorithms, or having some ground truth labels available, moving the problem into the semi-supervised space. This preliminary study proposes a framework for semi-automated hyperparameter tuning of clustering problems, using a grid search to develop a series of graphs and easy to interpret metrics that can then be used for more efficient domain-specific evaluation. Preliminary results show that internal metrics are unable to capture the semantic quality of the clusters developed and approaches driven by internal metrics would come to different conclusions than those driven by manual evaluation.


title: Understanding of Kernels in CNN Models by Suppressing Irrelevant Visual Features in Images

abstract: Deep learning models have shown their superior performance in various vision tasks. However, the lack of precisely interpreting kernels in convolutional neural networks (CNNs) is becoming one main obstacle to wide applications of deep learning models in real scenarios. Although existing interpretation methods may find certain visual patterns which are associated with the activation of a specific kernel, those visual patterns may not be specific or comprehensive enough for interpretation of a specific activation of kernel of interest. In this paper, a simple yet effective optimization method is proposed to interpret the activation of any kernel of interest in CNN models. The basic idea is to simultaneously preserve the activation of the specific kernel and suppress the activation of all other kernels at the same layer. In this way, only visual information relevant to the activation of the specific kernel is remained in the input. Consistent visual information from multiple modified inputs would help users understand what kind of features are specifically associated with specific kernel. Comprehensive evaluation shows that the proposed method can help better interpret activation of specific kernels than widely used methods, even when two kernels have very similar activation regions from the same input image.


title: Normal Learning in Videos with Attention Prototype Network

abstract: Frame reconstruction (current or future frame) based on Auto-Encoder (AE) is a popular method for video anomaly detection. With models trained on the normal data, the reconstruction errors of anomalous scenes are usually much larger than those of normal ones. Previous methods introduced the memory bank into AE, for encoding diverse normal patterns across the training videos. However, they are memory consuming and cannot cope with unseen new scenarios in the testing data. In this work, we propose a self-attention prototype unit (APU) to encode the normal latent space as prototypes in real time, free from extra memory cost. In addition, we introduce circulative attention mechanism to our backbone to form a novel feature extracting learner, namely Circulative Attention Unit (CAU). It enables the fast adaption capability on new scenes by only consuming a few iterations of update. Extensive experiments are conducted on various benchmarks. The superior performance over the state-of-the-art demonstrates the effectiveness of our method. Our code is available at https://github.com/huchao-AI/APN/.


title: Social Norm Bias: Residual Harms of Fairness-Aware Algorithms

abstract: Many modern machine learning algorithms mitigate bias by enforcing fairness constraints across coarsely-defined groups related to a sensitive attribute like gender or race. However, these algorithms seldom account for within-group heterogeneity and biases that may disproportionately affect some members of a group. In this work, we characterize Social Norm Bias (SNoB), a subtle but consequential type of algorithmic discrimination that may be exhibited by machine learning models, even when these systems achieve group fairness objectives. We study this issue through the lens of gender bias in occupation classification. We quantify SNoB by measuring how an algorithm's predictions are associated with conformity to inferred gender norms. When predicting if an individual belongs to a male-dominated occupation, this framework reveals that "fair" classifiers still favor biographies written in ways that align with inferred masculine norms. We compare SNoB across algorithmic fairness methods and show that it is frequently a residual bias, and post-processing approaches do not mitigate this type of bias at all.


title: Opportunistic Emulation of Computationally Expensive Simulations via Deep Learning

abstract: With the underlying aim of increasing efficiency of computational modelling pertinent for managing & protecting the Great Barrier Reef, we perform a preliminary investigation on the use of deep neural networks for opportunistic model emulation of APSIM models by repurposing an existing large dataset containing outputs of APSIM model runs. The dataset has not been specifically tailored for the model emulation task. We employ two neural network architectures for the emulation task: densely connected feed-forward neural network (FFNN), and gated recurrent unit feeding into FFNN (GRU-FFNN), a type of a recurrent neural network. Various configurations of the architectures are trialled. A minimum correlation statistic is used to identify clusters of APSIM scenarios that can be aggregated to form training sets for model emulation. We focus on emulating 4 important outputs of the APSIM model: runoff, soil_loss, DINrunoff, Nleached. The GRU-FFNN architecture with three hidden layers and 128 units per layer provides good emulation of runoff and DINrunoff. However, soil_loss and Nleached were emulated relatively poorly under a wide range of the considered architectures; the emulators failed to capture variability at higher values of these two outputs. While the opportunistic data available from past modelling activities provides a large and useful dataset for exploring APSIM emulation, it may not be sufficiently rich enough for successful deep learning of more complex model dynamics. Design of Computer Experiments may be required to generate more informative data to emulate all output variables of interest. We also suggest the use of synthetic meteorology settings to allow the model to be fed a wide range of inputs. These need not all be representative of normal conditions, but can provide a denser, more informative dataset from which complex relationships between input and outputs can be learned.


title: Topological Bifurcation Structure Of One-Parameter Families Of $C^1$ Unimodal Maps

abstract: We consider the bifurcation structure of one-parameter families of unimodal maps whose differentiability is only $C^1$. The structure of its bifurcation diagram can be a very wild one in such case. However we prove that in a certain topological sense, the structure is the same as that of the standard family of quadratic polynomials. In the case of families of polynomials, irreducible component of the bifurcation diagram can be defined naturally by dividing by the polynomials corresponding to lower periods. We show that such a irreducible component can be defined even if the maps and the family satisfy only a very mild differentiability condition. By removing components of lower periods, the structure of the bifurcation diagram becomes a considerably simplified one. We prove that the symbolic condition for the irreducible components is exactly the same as that of the standard family of quadratic polynomials. When we consider families of maps without strict conditions, the bifurcation diagrams may have infinitely many wild components. We show that such a situation does not affect the irreducible component essentially by proving a separation theorem for compact set in the plane which asserts that a given connected component can be cut out from the compact set by a curve.


title: The role of coupling radius in 1D and 2D SQUID and SQIF arrays

abstract: We investigate theoretically the effect of the coupling radius on the transfer function in 1D and 2D SQUID arrays with different number of Josephson junctions in parallel and series at 77 K. Our results show a plateauing of the array maximum transfer function with the number of junctions in parallel. The plateauing defines the array coupling radius which we show increases with decreasing the normalised impedance of the SQUID loop inductance. The coupling radius is found to be independent of the number of junctions in series. Finally, we investigate the voltage versus magnetic field response and maximum transfer function of one 1D and two 2D SQIF arrays with different SQUID loop area distributions.


title: Comprehensive search for buckled honeycomb binary compounds based on noble metals (Cu, Ag, and Au)

abstract: Honeycomb structure has been frequently observed in two-dimensional (2D) materials. CuAu in the buckled honeycomb (BHC) structure has been synthesized recently, which is the first case of 2D intermetallic compounds. Here, the dynamical stability of 2D $AX$ in the BHC structure, where $A=$ Cu, Ag, and Au and $X$ is a metallic element in the periodic table, is systematically studied by calculating phonon dispersions from first-principles. Among 135 $AX$, more than 50 $AX$ are identified to be dynamically stable. In addition, (i) a relationship between the dynamical stability and the formation energy, (ii) a correlation of dynamical stability between different constituents $A$, (iii) a trend of lattice parameters, and (iv) electronic and magnetic properties are discussed. Furthermore, a stable phase of B11-type AuZr is predicted based on both the result (ii) and the stability relationship between 2D and three-dimensional structures. The present findings stimulate future studies exploring physics and chemistry of 2D intermetallic compounds.


title: Toeplitz operators on CR manifolds and group actions

abstract: Let $(X, T^{1,0}X)$ be a connected orientable compact CR manifold of dimension $2n+1$, $n \geq 1$ with non-degenerate Levi curvature. In this paper, we study the algebra of Toeplitz operators on $X$ and we establish star product for some class of symbols on $X$. In the second part of this paper, we consider a compact locally free Lie group $G$ acting on $X$ and we investigate the associated algebra of $G$-invariant Toeplitz operators.


title: Spectra and decay properties of $\Lambda_b$ and $\Sigma_b$ baryons

abstract: In this article, we study the radial states as well as orbital states mass spectra of the nonstrange baryons from bottom family utilizing hypercentral Constituent Quark Model(hCQM), a non-relativistic approach by employing screened potential as confining potential with color Coulomb potential. The spin-spin, spin-orbital and tensor interaction are considered for hyperfine splitting calculation. The mass spectra calculated and compared with other theoretical approaches. The Regge trajectories has been plotted in $(J, M^2)$ plane using the calculated mass spectra. Further, the single-pion decay and radiative decay have been described and magnetic moments are determined for the ground state.


title: Viola: A Topic Agnostic Generate-and-Rank Dialogue System

abstract: We present Viola, an open-domain dialogue system for spoken conversation that uses a topic-agnostic dialogue manager based on a simple generate-and-rank approach. Leveraging recent advances of generative dialogue systems powered by large language models, Viola fetches a batch of response candidates from various neural dialogue models trained with different datasets and knowledge-grounding inputs. Additional responses originating from template-based generators are also considered, depending on the user's input and detected entities. The hand-crafted generators build on a dynamic knowledge graph injected with rich content that is crawled from the web and automatically processed on a daily basis. Viola's response ranker is a fine-tuned polyencoder that chooses the best response given the dialogue history. While dedicated annotations for the polyencoder alone can indirectly steer it away from choosing problematic responses, we add rule-based safety nets to detect neural degeneration and a dedicated classifier to filter out offensive content. We analyze conversations that Viola took part in for the Alexa Prize Socialbot Grand Challenge 4 and discuss the strengths and weaknesses of our approach. Lastly, we suggest future work with a focus on curating conversation data specifcially for socialbots that will contribute towards a more robust data-driven socialbot.


title: An Electroencephalography connectome predictive model of major depressive disorder severity

abstract: Emerging evidence showed that major depressive disorder (MDD) is associated with disruptions of brain structural and functional networks, rather than impairment of isolated brain region. Thus, connectome-based models capable of predicting the depression severity at the individual level can be clinically useful. Here, we applied a machine-learning approach to predict the severity of depression using resting-state networks derived from source-reconstructed Electroencephalography (EEG) signals. Using regression models and three independent EEG datasets (N=328), we tested whether resting state functional connectivity could predict individual depression score. On the first dataset, results showed that individuals scores could be reasonably predicted (r=0.61, p=4 x 10-18) using intrinsic functional connectivity in the EEG alpha band (8-13 Hz). In particular, the brain regions which contributed the most to the predictive network belong to the default mode network. We further tested the predictive potential of the established model by conducting two external validations on (N1=53, N2=154). Results showed high significant correlations between the predicted and the measured depression scale scores (r1= 0.49, r2=0.37, p<0.001). These findings lay the foundation for developing a generalizable and scientifically interpretable EEG network-based markers that can ultimately support clinicians in a biologically-based characterization of MDD.


title: On the equivalence of viscosity solutions and distributional solutions for the time-fractional diffusion equation

abstract: We consider an initial-boundary value problem for the time-fractional diffusion equation. We prove the equivalence of two notions of weak solutions, viscosity solutions and distributional solutions.


title: Variational inference for cutting feedback in misspecified models

abstract: Bayesian analyses combine information represented by different terms in a joint Bayesian model. When one or more of the terms is misspecified, it can be helpful to restrict the use of information from suspect model components to modify posterior inference. This is called "cutting feedback", and both the specification and computation of the posterior for such "cut models" is challenging. In this paper, we define cut posterior distributions as solutions to constrained optimization problems, and propose optimization-based variational methods for their computation. These methods are faster than existing Markov chain Monte Carlo (MCMC) approaches for computing cut posterior distributions by an order of magnitude. It is also shown that variational methods allow for the evaluation of computationally intensive conflict checks that can be used to decide whether or not feedback should be cut. Our methods are illustrated in a number of simulated and real examples, including an application where recent methodological advances that combine variational inference and MCMC within the variational optimization are used.


title: Microlocal analysis of d-plane transform on the Euclidean space

abstract: We study the basic properties of d-plane transform on the Euclidean space as a Fourier integral operator, and its application to the microlocal analysis of streaking artifacts in its filtered back-projection. The d-plane transform is defined by integrals of functions on the n-dimensional Euclidean space over all the d-dimensional planes, where 0<d<n. This maps functions on the Euclidean space to those on the affine Grassmannian G(d,n). This is said to be X-ray transform if d=1 and Radon transform if d=n-1. When n=2 the X-ray transform is thought to be measurements of CT scanners. In this paper we obtain concrete expression of the canonical relation of the d-plane transform and quantitative properties of the filtered back-projection of the product of the images of the d-plane transform. The latter one is related to the metal streaking artifacts of CT images, and some generalization of recent results of Park-Choi-Seo (2017) and Palacios-Uhlmann-Wang (2018) for the X-ray transform on the plane.


title: Understanding Longitudinal Dynamics of Recommender Systems with Agent-Based Modeling and Simulation

abstract: Today's research in recommender systems is largely based on experimental designs that are static in a sense that they do not consider potential longitudinal effects of providing recommendations to users. In reality, however, various important and interesting phenomena only emerge or become visible over time, e.g., when a recommender system continuously reinforces the popularity of already successful artists on a music streaming site or when recommendations that aim at profit maximization lead to a loss of consumer trust in the long run. In this paper, we discuss how Agent-Based Modeling and Simulation (ABM) techniques can be used to study such important longitudinal dynamics of recommender systems. To that purpose, we provide an overview of the ABM principles, outline a simulation framework for recommender systems based on the literature, and discuss various practical research questions that can be addressed with such an ABM-based simulation framework.


title: A vanishing theorem for the canonical blow-ups of Grassmann manifolds

abstract: Let $\mathcal T_{s,p,n}$ be the canonical blow-up of the Grassmann manifold $G(p,n)$ constructed by blowing up the Pl\"ucker coordinate subspaces associated with the parameter $s$. We prove that the higher cohomology groups of the tangent bundle of $\mathcal T_{s,p,n}$ vanish. As an application, $\mathcal T_{s,p,n}$ is locally rigid in the sense of Kodaira-Spencer.


title: Membrane fouling: microscopic insights into the effects of surface chemistry and roughness

abstract: Fouling is a major obstacle and challenge in membrane-based separation processes. Caused by the sophisticated interactions between foulant and membrane surface, fouling strongly depends on membrane surface chemistry and morphology. Current studies in the field have been largely focused on polymer membranes. Herein, we report a molecular simulation study for fouling on alumina and graphene membrane surfaces during water treatment. For two foulants (sucralose and bisphenol A), the fouling on alumina surfaces is reduced with increasing surface roughness; however, the fouling on graphene surfaces is enhanced by roughness. It is unravelled that the foulant-surface interaction becomes weaker in the ridge region of a rough alumina surface, thus allowing foulant to leave the surface and reducing fouling. Such behavior is not observed on a rough graphene surface because of the strong foulant-graphene interaction. Moreover, with increasing roughness, the hydrogen bonds formed between water and alumina surfaces are found to increase in number as well as stability. By scaling the atomic charges of alumina, fouling behavior on alumina surfaces is shifted to the one on graphene surfaces. This simulation study reveals that surface chemistry and roughness play a crucial role in membrane fouling, and the microscopic insights are useful for the design of new membranes towards high-performance water treatment.


title: Decentralized optimization with non-identical sampling in presence of stragglers

abstract: We consider decentralized consensus optimization when workers sample data from non-identical distributions and perform variable amounts of work due to slow nodes known as stragglers. The problem of non-identical distributions and the problem of variable amount of work have been previously studied separately. In our work we analyze them together under a unified system model. We study the convergence of the optimization algorithm when combining worker outputs under two heuristic methods: (1) weighting equally, and (2) weighting by the amount of work completed by each. We prove convergence of the two methods under perfect consensus, assuming straggler statistics are independent and identical across all workers for all iterations. Our numerical results show that under approximate consensus the second method outperforms the first method for both convex and non-convex objective functions. We make use of the theory on minimum variance unbiased estimator (MVUE) to evaluate the existence of an optimal method for combining worker outputs. While we conclude that neither of the two heuristic methods are optimal, we also show that an optimal method does not exist.


title: Learning Class-level Prototypes for Few-shot Learning

abstract: Few-shot learning aims to recognize new categories using very few labeled samples. Although few-shot learning has witnessed promising development in recent years, most existing methods adopt an average operation to calculate prototypes, thus limited by the outlier samples. In this work, we propose a simple yet effective framework for few-shot classification, which can learn to generate preferable prototypes from few support data, with the help of an episodic prototype generator module. The generated prototype is meant to be close to a certain \textit{\targetproto{}} and is less influenced by outlier samples. Extensive experiments demonstrate the effectiveness of this module, and our approach gets a significant raise over baseline models, and get a competitive result compared to previous methods on \textit{mini}ImageNet, \textit{tiered}ImageNet, and cross-domain (\textit{mini}ImageNet $\rightarrow$ CUB-200-2011) datasets.


title: On the pitchfork bifurcation for the Chafee-Infante equation with additive noise

abstract: We investigate pitchfork bifurcations for a stochastic reaction diffusion equation perturbed by an infinite-dimensional Wiener process. It is well-known that the random attractor is a singleton, independently of the value of the bifurcation parameter; this phenomenon is often referred to as the "destruction" of the bifurcation by the noise. Analogous to the results of [Callaway et al., AIHP Probab. Stat., 53:1548-1574, 2017] for a 1D stochastic ODE, we show that some remnant of the bifurcation persists for this SPDE model in the form of a positive finite-time Lyapunov exponent. Additionally, we prove finite-time expansion of volume with increasing dimension as the bifurcation parameter crosses further eigenvalues of the Laplacian.


title: Testing for directed information graphs

abstract: In this paper, we study a hypothesis test to determine the underlying directed graph structure of nodes in a network, where the nodes represent random processes and the direction of the links indicate a causal relationship between said processes. Specifically, a k-th order Markov structure is considered for them, and the chosen metric to determine a connection between nodes is the directed information. The hypothesis test is based on the empirically calculated transition probabilities which are used to estimate the directed information. For a single edge, it is proven that the detection probability can be chosen arbitrarily close to one, while the false alarm probability remains negligible. When the test is performed on the whole graph, we derive bounds for the false alarm and detection probabilities, which show that the test is asymptotically optimal by properly setting the threshold test and using a large number of samples. Furthermore, we study how the convergence of the measures relies on the existence of links in the true graph.


title: Asymptotic Approximations for the Phase Space Schrodinger Equation

abstract: We consider semi-classical time evolution for the phase space Schr\"{o}dinger equation and present two methods of constructing short time asymptotic solutions. The first method consists of constructing a semi-classical phase space propagator in terms of semi-classical Gaussian wave packets on the basis of the Anisotropic Gaussian Approximation, related to the Nearby Orbit Approximation, by which we derive an asymptotic solution for configuration space WKB initial data. The second method consists of constructing a phase space narrow beam asymptotic solution, following the Complex WKB Theory developed by Maslov, on the basis of a canonical system in double phase space related to the Berezin-Shubin-Marinov Hamilton-Jacobi and transport equations. We illustrate the methods for sub-quadratic potentials in $\mathbb{R}$.


title: A TensorFlow Simulation Framework for Scientific Computing of Fluid Flows on Tensor Processing Units

abstract: A computational fluid dynamics (CFD) simulation framework for fluid-flow prediction is developed on the Tensor Processing Unit (TPU) platform. The TPU architecture is featured with accelerated dense matrix multiplication, large high bandwidth memory, and a fast inter-chip interconnect, making it attractive for high-performance scientific computing. The CFD framework solves the variable-density Navier-Stokes equation using a low-Mach approximation, and the governing equations are discretized by a finite-difference method on a collocated structured mesh. It uses the graph-based TensorFlow as the programming paradigm. The accuracy and performance of this framework is studied both numerically and analytically, specifically focusing on effects of TPU-native single precision floating point arithmetic. The algorithm and implementation are validated with canonical 2D and 3D Taylor-Green vortex simulations. To demonstrate the capability for simulating turbulent flows, simulations are conducted for two configurations, namely decaying homogeneous isotropic turbulence and a turbulent planar jet. Both simulations show good statistical agreement with reference solutions. The performance analysis shows a linear weak scaling and a superlinear strong scaling up to a full TPU v3 pod with 2048 cores.

categories: physics.comp-ph cs.NA math.NA physics.flu-dyn


title: The Anisotropic Gaussian Semi-Classical Schr\"{o}dinger Propagator

abstract: We present a construction of the Anisotropic Gaussian Semi-Classical Schr\"{o}dinger Propagator, emblematic of a class of Fourier Integral Operators of quadratic phase kernels related to the Schr\"{o}dinger equation. We deduce a set of algebraic relations of the variational matrices, solutions of the variational system pertaining to single Gaussian wave packet semi-classical time evolution, representing the symplectic and other invariances of the dynamics, which are subsequently used to derive the Van Vleck formula from the semi-classical propagator, as an argument for the practical importance of the later relations in the relevant wave packet calculus.


title: Semiclassical analysis and the Agmon-Finsler metric for discrete Schr\"odinger operators

abstract: The Agmon estimate for multi-dimensional discrete Schr\"{o}dinger operators is studied with emphasis on the microlocal analysis on the torus. We first consider the semiclassical setting where semiclassical continuous Schr\"{o}dinger operators are discretized with the mesh width proportional to the semiclassical parameter. Under this setting, the Agmon estimate for eigenfunctions is described by an Agmon metric, which is a Finsler metric rather than a Riemannian metric. Klein-Rosenberger (2008) proved this by a different argument in the case of a potential minimum. We also prove the Agmon estimate and the optimal anisotropic exponential decay of eigenfunctions for discrete Schr\"{o}dinger operators in the non-semiclassical standard setting.


title: A note on Chern coefficients and Cohen-Macaulay rings

abstract: In this paper, we investigate the relationship between the index of reducibility and Chern coefficients for primary ideals. As an application, we give characterizations of a Cohen-Macaulay ring in terms of its type, irreducible multiplicity, and Chern coefficients with respect to certain parameter ideals in Noetherian local rings.


title: Heredity-aware Child Face Image Generation with Latent Space Disentanglement

abstract: Generative adversarial networks have been widely used in image synthesis in recent years and the quality of the generated image has been greatly improved. However, the flexibility to control and decouple facial attributes (e.g., eyes, nose, mouth) is still limited. In this paper, we propose a novel approach, called ChildGAN, to generate a child's image according to the images of parents with heredity prior. The main idea is to disentangle the latent space of a pre-trained generation model and precisely control the face attributes of child images with clear semantics. We use distances between face landmarks as pseudo labels to figure out the most influential semantic vectors of the corresponding face attributes by calculating the gradient of latent vectors to pseudo labels. Furthermore, we disentangle the semantic vectors by weighting irrelevant features and orthogonalizing them with Schmidt Orthogonalization. Finally, we fuse the latent vector of the parents by leveraging the disentangled semantic vectors under the guidance of biological genetic laws. Extensive experiments demonstrate that our approach outperforms the existing methods with encouraging results.


title: Selective copper recovery from ammoniacal waste streams using a systematic biosorption process

abstract: Cu-NH3 bearing effluents arise from electroplating and metal extraction industries, requiring innovative and sustainable Cu recovery technologies to reduce their adverse environmental impact. CO32- and Zn are often co-occurring, and thus, selective Cu recovery from these complex liquid streams is required for economic viability. This study assessed 23 sustainable biosorbents classified as tannin-rich, lignin-rich, chitosan/chitin, dead biomass, macroalgae or biochar for their Cu adsorption capacity and selectivity in a complex NH3-bearing bioleachate. Under a preliminary screen with 12 mM Cu in 1 M ammoniacal solution, most biosorbents showed optimal Cu adsorption at pH 11, with pinecone remarkably showing high removal efficiencies (up to 68%) at all tested pH values. Further refinements on select biosorbents with pH, contact time, and presence of NH3, Zn and CO32- showed again that pinecone has a high maximum adsorption capacity (1.07 mmol g-1), worked over pH 5-12 and was Cu-selective with 3.97 selectivity quotient (KCu/Zn). Importantly, pinecone performance was maintained in a real Cu/NH3/Zn/CO32- bioleachate, with 69.4% Cu removal efficiency. Unlike synthetic adsorbents, pinecones require no pre-treatment, which together with its abundance, selectivity, and efficiency without the need for prior NH3 removal, makes it a competitive and sustainable Cu biosorbent for complex Cu-NH3 bearing streams. Overall, this study demonstrated the potential of integrating bioleaching and biosorption as a clean Cu recovery technology utilizing only sustainable resources (i.e., bio-lixiviant and biosorbents). This presents a closed-loop approach to Cu extraction and recovery from wastes, thus effectively addressing elemental sustainability.


title: 3D Face Recognition: A Survey

abstract: Face recognition is one of the most studied research topics in the community. In recent years, the research on face recognition has shifted to using 3D facial surfaces, as more discriminating features can be represented by the 3D geometric information. This survey focuses on reviewing the 3D face recognition techniques developed in the past ten years which are generally categorized into conventional methods and deep learning methods. The categorized techniques are evaluated using detailed descriptions of the representative works. The advantages and disadvantages of the techniques are summarized in terms of accuracy, complexity and robustness to face variation (expression, pose and occlusions, etc). The main contribution of this survey is that it comprehensively covers both conventional methods and deep learning methods on 3D face recognition. In addition, a review of available 3D face databases is provided, along with the discussion of future research challenges and directions.


title: Mimicking the $\Lambda$CDM Universe through inhomogeneous space-time

abstract: Starting from an inhomogeneous space-time model of the universe we could recreate a scenario of recent time accelerating universe dominated by Dark Energy type of fluid. The background matter component of such a universe was considered to be made up of a combination of an anisotropic fluid, a barotropic fluid and the presureless cold dark matter. It was found that inhomogeneity exhibits itself as the curvature term in such a universe. We corroborated our model with recent supernova Ia-JLA data together with $H_{0}$ data and BAO data. Cosmographic analysis of the dynamical variables further show that the model can mimic the $\Lambda$CDM cosmology very closely.


title: Transformer for Single Image Super-Resolution

abstract: Single image super-resolution (SISR) has witnessed great strides with the development of deep learning. However, most existing studies focus on building more complex networks with a massive number of layers. Recently, more and more researchers start to explore the application of Transformer in computer vision tasks. However, the heavy computational cost and high GPU memory occupation of the vision Transformer cannot be ignored. In this paper, we propose a novel Efficient Super-Resolution Transformer (ESRT) for SISR. ESRT is a hybrid model, which consists of a Lightweight CNN Backbone (LCB) and a Lightweight Transformer Backbone (LTB). Among them, LCB can dynamically adjust the size of the feature map to extract deep features with a low computational cost. LTB is composed of a series of Efficient Transformers (ET), which occupies a small GPU memory occupation, thanks to the specially designed Efficient Multi-Head Attention (EMHA). Extensive experiments show that ESRT achieves competitive results with low computational costs. Compared with the original Transformer which occupies 16,057M GPU memory, ESRT only occupies 4,191M GPU memory. All codes are available at https://github.com/luissen/ESRT.


title: Proof of a conjecture of Sturmfels, Timme and Zwiernik

abstract: We prove a conjecture of Sturmfels, Timme and Zwiernik on the ML-degrees of linear covariance models in algebraic statistics. As in our previous works on linear concentration models, the proof ultimately relies on the computation of certain intersection numbers on the varieties of complete quadrics.


title: Simulation of Scanning Near-Field Optical Microscopy Spectra of 1D Plasmonic Graphene Junctions

abstract: We present numerical simulations of scattering-type Scanning Near-Field Optical Microscopy (s-SNOM) of 1D plasmonic graphene junctions. A comprehensive analysis of simulated s-SNOM spectra is performed for three types of junctions. We find conditions when the conventional interpretation of the plasmon reflection coefficients from s-SNOM measurements does not apply. Our results are applicable to other conducting 2D materials and provide a comprehensive understanding of the s-SNOM techniques for probing local transport properties of 2D materials.


title: Canonical stretched rings

abstract: In this paper, we introduce the concept of canonical stretched rings, sparse stretched rings and maximum sparse ideals. Then we give characterizations of canonical stretched rings and sparse stretched rings; and a characterization of Gorenstein rings in terms of their maximum sparse ideals. Several explicit examples are provided along the paper to illustrate such rings.


title: Robust AC Transmission Expansion Plans from A Novel Dual Based Bi-level Approach

abstract: The rapid integration of Renewable Energy Sources (RESs) strengthens the need for a power network that can robustly handle the system's uncertain scenarios. Thus, this paper proposes the first nonlinear novel dual based bi-level approach for robust AC Transmission Expansion Planning (TEP) plans with uncertainties in RES generations and loads. It utilizes a convex relaxation and is solved by Benders Decomposition (BD), where the master determines the robust AC TEP plan. The novel dual slave model for the second level of BD circumvents the issues in using the conventional conic dual theory and aids in the worst-case realization of uncertainties using additional novel constraints. The novel dual slave is solved using Interior Point Method (IPM), as it is not a mixed-integer problem. The proposed work also includes additional linear constraints to reduce the BD's slow convergence and direct the master towards optimality. The robustness of the AC TEP plans is verified by Monte-Carlo Simulation (MCS) of the actual nonlinear and non-convex AC Optimal Power Flow (OPF). The effect of the budget of uncertainty on the AC TEP plans is also investigated. A comparison with the results of a previous work reveals the superiority of the proposed work.


title: Detecting Drill Failure in the Small Short-sound Drill Dataset

abstract: Monitoring the conditions of machines is vital in the manufacturing industry. Early detection of faulty components in machines for stopping and repairing the failed components can minimize the downtime of the machine. This article presents an approach to detect the failure occurring in drill machines based on drill sounds from Valmet AB. The drill dataset includes three classes: anomalous sounds, normal sounds, and irrelevant sounds, which are also labeled as "Broken", "Normal", and "Other", respectively. Detecting drill failure effectively remains a challenge due to the following reasons. The waveform of drill sound is complex and short for detection. Additionally, in realistic soundscapes, there are sounds and noise in the context at the same time. Moreover, the balanced dataset is small to apply state-of-the-art deep learning techniques. To overcome these aforementioned difficulties, we augmented sounds to increase the number of sounds in the dataset. We then proposed a convolutional neural network (CNN) combined with a long short-term memory (LSTM) to extract features from log-Mel spectrograms and learn global high-level feature representation for the classification of three classes. A leaky rectified linear unit (Leaky ReLU) was utilized as the activation function for our proposed CNN instead of the rectified linear unit (ReLU). Moreover, we deployed an attention mechanism at the frame level after the LSTM layer to learn long-term global feature representations. As a result, the proposed method reached an overall accuracy of 92.35% for the drill failure detection system.


title: Some identities of fully degenerate Dowling and fully degenerate Bell polynomials arising from lambda-umbral calculus

abstract: Recently, Kim-Kim introduced the lambda-umbral calculus, in which the lambda-Sheffer sequences occupy the central position. In this paper, we introduce the fully degenerate Bell and the fully degenerate Dowling polynomials, and investigate some properties and identities relating to those polynomials with the help oflambda-umbral calculus. Here we note that the fully degenerate Bell poynomials and the fully degenerate Dowling polynomials are respectively degenerate versions of the Bell polynomials and the Dowling polynomials, of which the latters are the natural extension of the Whitney numbers of the second kind.


title: RSSi-based visitor tracking in museums via cascaded AI classifiers and coloured graph representations

abstract: Individual tracking of museum visitors based on portable radio beacons, an asset for behavioural analyses and comfort/performance improvements, is seeing increasing diffusion. Conceptually, this approach enables room-level localisation based on a network of small antennas (thus, without invasive modification of the existent structures). The antennas measure the intensity (RSSi) of self-advertising signals broadcasted by beacons individually assigned to the visitors. The signal intensity provides a proxy for the distance to the antennas and thus indicative positioning. However, RSSi signals are well-known to be noisy, even in ideal conditions (high antenna density, absence of obstacles, absence of crowd, ...). In this contribution, we present a method to perform accurate RSSi-based visitor tracking when the density of antennas is relatively low, e.g. due to technical constraints imposed by historic buildings. We combine an ensemble of "simple" localisers, trained based on ground-truth, with an encoding of the museum topology in terms of a total-coloured graph. This turns the localisation problem into a cascade process, from large to small scales, in space and in time. Our use case is visitors tracking in Galleria Borghese, Rome (Italy), for which our method manages >96% localisation accuracy, significantly improving on our previous work (J. Comput. Sci. 101357, 2021).


title: INVIGORATE: Interactive Visual Grounding and Grasping in Clutter

abstract: This paper presents INVIGORATE, a robot system that interacts with human through natural language and grasps a specified object in clutter. The objects may occlude, obstruct, or even stack on top of one another. INVIGORATE embodies several challenges: (i) infer the target object among other occluding objects, from input language expressions and RGB images, (ii) infer object blocking relationships (OBRs) from the images, and (iii) synthesize a multi-step plan to ask questions that disambiguate the target object and to grasp it successfully. We train separate neural networks for object detection, for visual grounding, for question generation, and for OBR detection and grasping. They allow for unrestricted object categories and language expressions, subject to the training datasets. However, errors in visual perception and ambiguity in human languages are inevitable and negatively impact the robot's performance. To overcome these uncertainties, we build a partially observable Markov decision process (POMDP) that integrates the learned neural network modules. Through approximate POMDP planning, the robot tracks the history of observations and asks disambiguation questions in order to achieve a near-optimal sequence of actions that identify and grasp the target object. INVIGORATE combines the benefits of model-based POMDP planning and data-driven deep learning. Preliminary experiments with INVIGORATE on a Fetch robot show significant benefits of this integrated approach to object grasping in clutter with natural language interactions. A demonstration video is available at https://youtu.be/zYakh80SGcU.


title: Pulsating hydrogen-deficient white dwarfs and pre-white dwarfs observed with TESS II. Discovery of two new GW Vir stars: TIC333432673 and TIC095332541

abstract: In this paper, we present the observations of two new GW Vir stars from the extended \textit{TESS} mission in both 120\,s short-cadence and 20\,s ultra-short-cadence mode of two pre-white dwarf stars showing hydrogen deficiency. We performed an asteroseismological analysis of these stars on the basis of PG~1159 evolutionary models that take into account the complete evolution of the progenitor stars. We searched for patterns of uniform period spacings in order to constrain the stellar mass of the stars, and employed the individual observed periods to search for a representative seismological model. The analysis of the {\it TESS} light curves of TIC\,333432673 and TIC\,095332541 reveals the presence of several oscillations with periods ranging from 350 to 500~s associated to typical gravity ($g$)-modes. From follow-up ground-based spectroscopy, we find that both stars have similar effective temperature ($T_\mathrm{eff} = 120,000 \pm 10,000$\,K) and surface gravity ($\log g = 7.5 \pm 0.5$) but a different He/C composition. On the basis of PG~1159 evolutionary tracks, we derived a spectroscopic mass of $M_{\star}$ = $0.58^{+0.16}_{-0.08}\,M_{\odot}$ for both stars. Our asteroseismological analysis of TIC\,333432673 allowed us to find a constant period spacing compatible with a stellar mass $M_{\star}\sim 0.60-0.61\,M_{\odot}$, and an asteroseismological model for this star with a stellar mass $M_{\star}$ = $0.589\pm 0.020$ $M_{\odot}$, and a seismological distance of $d= 459^{+188}_{-156}$ pc. For this star, we find an excellent agreement between the different methods to infer the stellar mass, and also between the seismological distance and that measured with {\it Gaia} ($d_{\rm Gaia}= 389^{+5.6}_{-5.2}$ pc). For TIC\,095332541, we have found a possible period spacing that suggests a stellar mass of $M_{\star}\sim 0.55-0.57\,M_{\odot}$.


title: Probing charged lepton flavor violation with axion-like particles at Belle II

abstract: We study charged lepton flavor violation associated with a light leptophilic axion-like particle (ALP), $X$, at the $B$-factory experiment Belle II. We focus on production of the ALP in the tau decays $\tau \to X l$ with $l=e,\mu$, followed by its decay via $X\to l^- l^+$. The ALP can be either promptly decaying or long-lived. We perform Monte-Carlo simulations, recasting a prompt search at Belle for lepton-flavor-violating $\tau$ decays, and propose a displaced-vertex (DV) search. For both types of searches, we derive the Belle~II sensitivity reaches in both the product of branching fractions and the ALP coupling constants, as functions of the ALP mass and lifetime. The results show that the DV search exceeds the sensitivity reach of the prompt search to the relevant branching fractions by up to about a factor of 40 in the long decay length regime.


title: Superconducting Microstrip Losses at Microwave and Sub-millimeter wavelengths

abstract: We present a lab-on-chip experiment to accurately measure losses of superconducting microstrip lines at microwave and sub-mm wavelengths. The microstrips are fabricated from NbTiN, which is deposited using reactive magnetron sputtering, and amorphous silicon which is deposited using plasma-enhanced chemical vapor deposition (PECVD). Sub-mm wave losses are measured using on-chip Fabry-P{\'e}rot resonators (FPR) operating around $350\ $GHz. Microwave losses are measured using shunted half-wave resonators with an identical geometry and fabricated on the same chip. We measure a loss tangent of the amorphous silicon at single-photon energies of $\tan\delta =3.7\pm0.5\times10^{-5}$ at $6\ $GHz and $\tan\delta = 2.1\pm 0.1\times10^{-4}$ at $350\ $GHz. These results represent very low losses for deposited dielectrics, but the sub-mm wave losses are significantly higher than the microwave losses, which cannot be understood using the standard two-level system loss model.


title: Learning From Long-Tailed Data With Noisy Labels

abstract: Class imbalance and noisy labels are the norm rather than the exception in many large-scale classification datasets. Nevertheless, most works in machine learning typically assume balanced and clean data. There have been some recent attempts to tackle, on one side, the problem of learning from noisy labels and, on the other side, learning from long-tailed data. Each group of methods make simplifying assumptions about the other. Due to this separation, the proposed solutions often underperform when both assumptions are violated. In this work, we present a simple two-stage approach based on recent advances in self-supervised learning to treat both challenges simultaneously. It consists of, first, task-agnostic self-supervised pre-training, followed by task-specific fine-tuning using an appropriate loss. Most significantly, we find that self-supervised learning approaches are effectively able to cope with severe class imbalance. In addition, the resulting learned representations are also remarkably robust to label noise, when fine-tuned with an imbalance- and noise-resistant loss function. We validate our claims with experiments on CIFAR-10 and CIFAR-100 augmented with synthetic imbalance and noise, as well as the large-scale inherently noisy Clothing-1M dataset.


title: Crystallization behaviors in superionic conductor Na$_3$PS$_4$

abstract: All-solid-state batteries using sodium are promising candidates for next-generation rechargeable batteries due to the limited lithium resources. A practical sodium battery requires an electrolyte with high conductivity. Cubic Na$_3$PS$_4$ exhibiting high conductivity of over 10$^{-4}$ S cm$^{-1}$ is obtained by crystallizing amorphous Na$_3$PS$_4$ synthesized by ball milling. Amorphous Na$_3$PS$_4$ crystallizes in a cubic structure and then is transformed into a tetragonal phase upon heating. In this study, in situ observation by transmission electron microscopy demonstrates that the crystallite size drastically increases during the transition from the cubic phase to the tetragonal phase. Moreover, an electron diffraction analysis reveals that amorphous domains and nano-sized crystallites coexist in the cubic Na$_3$PS$_4$ specimen, while the tetragonal phase contains micro-sized crystallites. The nano-sized crystallites and the composite formed by crystallites and amorphous domains are most likely responsible for the increase in conductivity in the cubic Na$_3$PS$_4$ specimens.


title: Monocular Depth Estimation Primed by Salient Point Detection and Normalized Hessian Loss

abstract: Deep neural networks have recently thrived on single image depth estimation. That being said, current developments on this topic highlight an apparent compromise between accuracy and network size. This work proposes an accurate and lightweight framework for monocular depth estimation based on a self-attention mechanism stemming from salient point detection. Specifically, we utilize a sparse set of keypoints to train a FuSaNet model that consists of two major components: Fusion-Net and Saliency-Net. In addition, we introduce a normalized Hessian loss term invariant to scaling and shear along the depth direction, which is shown to substantially improve the accuracy. The proposed method achieves state-of-the-art results on NYU-Depth-v2 and KITTI while using 3.1-38.4 times smaller model in terms of the number of parameters than baseline approaches. Experiments on the SUN-RGBD further demonstrate the generalizability of the proposed method.


title: Towards Informed Partitioning for Load Balancing: a Proof-of-Concept

abstract: Most parallel applications suffer from load imbalance, a crucial performance degradation factor. In particle simulations, this is mainly due to the migration of particles between processing elements, which eventually gather unevenly and create workload imbalance. Dynamic load balancing is used at various iterations to mitigate load imbalance, employing a partitioning method to divide the computational space evenly while minimizing communications. In this paper, we propose a novel partitioning methodology called ``informed partitioning''. It uses information based on the evolution of the computation to reduce the load balancing growth and the number of load balancing calls. We illustrate informed partitioning by proposing a new geometric partitioning technique for particles simulations. This technique is derived from the well-known recursive coordinate bisection and employs the velocity of the particles to guide the bisection axis. To properly compare the performance of our new method with existing partitioning techniques during application execution, we introduce an effort metric based on a theoretical model of load balanced parallel application time. We propose a proof-of-concept of informed partitioning, through a numerical study, on three N-Body simulations with various particle dynamics, and we discuss its performance against popular geometric partitioning techniques. Moreover, we show that our effort metric can be used to rank partitioning techniques by their efficiency at any time point during the simulation. Eventually, this could be used to choose the best partitioning on the fly. In the numerical study, we report that our novel concept increases the performance of two experiments out of three by up to 76% and 15%, while being marginally slower by only $3\%$ in one experiment. Also, we discuss the limitations of our implementation of informed partitioning and our effort metric.


title: Multi-Attributed and Structured Text-to-Face Synthesis

abstract: Generative Adversarial Networks (GANs) have revolutionized image synthesis through many applications like face generation, photograph editing, and image super-resolution. Image synthesis using GANs has predominantly been uni-modal, with few approaches that can synthesize images from text or other data modes. Text-to-image synthesis, especially text-to-face synthesis, has promising use cases of robust face-generation from eye witness accounts and augmentation of the reading experience with visual cues. However, only a couple of datasets provide consolidated face data and textual descriptions for text-to-face synthesis. Moreover, these textual annotations are less extensive and descriptive, which reduces the diversity of faces generated from it. This paper empirically proves that increasing the number of facial attributes in each textual description helps GANs generate more diverse and real-looking faces. To prove this, we propose a new methodology that focuses on using structured textual descriptions. We also consolidate a Multi-Attributed and Structured Text-to-face (MAST) dataset consisting of high-quality images with structured textual annotations and make it available to researchers to experiment and build upon. Lastly, we report benchmark Frechet's Inception Distance (FID), Facial Semantic Similarity (FSS), and Facial Semantic Distance (FSD) scores for the MAST dataset.


title: Detecting Small Objects in Thermal Images Using Single-Shot Detector

abstract: SSD (Single Shot Multibox Detector) is one of the most successful object detectors for its high accuracy and fast speed. However, the features from shallow layer (mainly Conv4_3) of SSD lack semantic information, resulting in poor performance in small objects. In this paper, we proposed DDSSD (Dilation and Deconvolution Single Shot Multibox Detector), an enhanced SSD with a novel feature fusion module which can improve the performance over SSD for small object detection. In the feature fusion module, dilation convolution module is utilized to enlarge the receptive field of features from shallow layer and deconvolution module is adopted to increase the size of feature maps from high layer. Our network achieves 79.7% mAP on PASCAL VOC2007 test and 28.3% mmAP on MS COCO test-dev at 41 FPS with only 300x300 input using a single Nvidia 1080 GPU. Especially, for small objects, DDSSD achieves 10.5% on MS COCO and 22.8% on FLIR thermal dataset, outperforming a lot of state-of-the-art object detection algorithms in both aspects of accuracy and speed.


title: Existence and stability results for an isoperimetric problem with a non-local interaction of Wasserstein type

abstract: The aim of this paper is to prove the existence of minimizers for a variational problem involving the minimization under volume constraint of the sum of the perimeter and a non-local energy of Wasserstein type. This extends previous partial results to the full range of parameters. We also show that in the regime where the perimeter is dominant, the energy is uniquely minimized by balls.


title: Post-Lie-Magnus expansion and BCH-recursion

abstract: We identify the Baker-Campbell-Hausdorff recursion driven by a weight$\lambda=1$ Rota-Baxter operator with the Magnus expansion relativeto the post-Lie structure naturally associated to the correspondingRota-Baxter algebra. Post-Lie Magnus expansion and BCH-recursionare reviewed before the proof of the main result.


title: On well-posedness for some Korteweg-De Vries type equations with variable coefficients

abstract: In this paper, KdV-type equations with time- and space-dependent coefficients are considered. Assuming that the dispersion coefficient in front of $u_{xxx}$ is positive and uniformly bounded away from the origin and that a primitive function of the ratio between the anti-dissipation and the dispersion coefficients is bounded from below, we prove the existence and uniqueness of a solution $u$ such that $h u$ belongs to a classical Sobolev space, where $h$ is a function related to this ratio. The LWP in $H^s(\mathbb{R})$, $s>1/2$, in the classical (Hadamard) sense is also proven under an assumption on the integrability of this ratio. Our approach combines a change of unknown with dispersive estimates. Note that previous results were restricted to $H^s(\mathbb{R})$, $s>3/2$, and only used the dispersion to compensate the anti-dissipation and not to lower the Sobolev index required for well-posedness.


title: Lightweight Monocular Depth with a Novel Neural Architecture Search Method

abstract: This paper presents a novel neural architecture search method, called LiDNAS, for generating lightweight monocular depth estimation models. Unlike previous neural architecture search (NAS) approaches, where finding optimized networks are computationally highly demanding, the introduced novel Assisted Tabu Search leads to efficient architecture exploration. Moreover, we construct the search space on a pre-defined backbone network to balance layer diversity and search space size. The LiDNAS method outperforms the state-of-the-art NAS approach, proposed for disparity and depth estimation, in terms of search efficiency and output model performance. The LiDNAS optimized models achieve results superior to compact depth estimation state-of-the-art on NYU-Depth-v2, KITTI, and ScanNet, while being 7%-500% more compact in size, i.e the number of model parameters.


title: Dropout against Deep Leakage from Gradients

abstract: As the scale and size of the data increases significantly nowadays, federal learning (Bonawitz et al. [2019]) for high performance computing and machine learning has been much more important than ever before (Abadi et al. [2016]). People used to believe that sharing gradients seems to be safe to conceal the local training data during the training stage. However, Zhu et al. [2019] demonstrated that it was possible to recover raw data from the model training data by detecting gradients. They use generated random dummy data and minimise the distance between them and real data. Zhao et al. [2020] pushes the convergence algorithm even further. By replacing the original loss function with cross entropy loss, they achieve better fidelity threshold. In this paper, we propose using an additional dropout (Srivastava et al. [2014]) layer before feeding the data to the classifier. It is very effective in preventing leakage of raw data, as the training data cannot converge to a small RMSE even after 5,800 epochs with dropout rate set to 0.5.


title: Precision measurements and tau neutrino physics in a future accelerator neutrino experiment

abstract: We investigate prospects of building a future accelerator-based neutrino oscillation experiment in China, including site selection, beam optimization and tau neutrino physics aspects. CP violation, non-unitary mixing and non-standard neutrino interactions are discussed. We simulate neutrino beam setups based on muon and beta decay techniques and compare Chinese laboratory sites by their expected sensitivities. A case study on Super Proton-Proton Collider and China JinPing Laboratory is also presented. It is shown that the muon-decay-based beam setup can measure the Dirac CP phase by about 14.2$^\circ$ precision at 1$\,\sigma$ CL, whereas non-unitarity can be probed down to $|\alpha_{i j}| \lesssim$ 0.37 ($i \neq j =$ 1, 2, 3) and non-standard interactions to $|\epsilon^m_{\ell \ell'}| \lesssim$ 0.11 ($\ell \neq \ell' = e$, $\mu$, $\tau$) at 90% CL, respectively.


title: Detection of terrestrial gamma-ray flashes with the AGILE/MCAL

abstract: AGILE is one of the satellites currently detecting terrestrial gamma-ray flashes (TGFs). In particular, the AGILE Mini-CALorimeter detected more than 2000 events in 8 years activity, by exploiting a unique sub-millisecond timescale trigger logic and high-energy range. A change in the onboard configuration enhanced the trigger capabilities for the detection of these events, overcoming dead time issues and enlarging the detection rate of these events up to $>$50 TGFs/month, allowing to reveal shorter duration flashes. The quasi-equatorial low-inclination ( 2.5$^{\circ}$) orbit of AGILE allows for the detection of repeated TGFs coming from the same storms, at the same orbital passage and throughout successive orbital overpasses, over the same geographic region. All TGFs detected by AGILE are fulfilling a database that can be used for offline analysis and forthcoming studies. The limited number of missions currently detecting these brief terrestrial flashes makes the understanding of this phenomenon very challenging and, in this perspective, the AGILE satellite played and still plays a major role, helping shedding light to many aspects of TGF science


title: Atomic-scale defects restricting structural superlubricity: Ab initio study study on the example of the twisted graphene bilayer

abstract: The potential energy surface (PES) of interlayer interaction of twisted bilayer graphene with vacancies in one of the layers is investigated via density functional theory (DFT) calculations with van der Waals corrections. These calculations give a non-negligible magnitude of PES corrugation of 28 meV per vacancy and barriers for relative sliding of the layers of 7 - 8 meV per vacancy for the moir\'e pattern with coprime indices (2,1) (twist angle 21.8$^\circ$). At the same time, using the semiempirical potential fitted to the DFT results, we confirm that twisted bilayer graphene without defects exhibits superlubricity for the same moir\'e pattern and the magnitude of PES corrugation for the infinite bilayer is below the calculation accuracy. Our results imply that atomic-scale defects restrict the superlubricity of 2D layers and can determine static and dynamic tribological properties of these layers in a superlubric state. We also analyze computationally cheap approaches that can be used for modeling of tribological behavior of large-scale systems with defects. The adequacy of using state-of-the-art semiempirical potentials for interlayer interaction and approximations based on the first spatial Fourier harmonics for the description of interaction between graphene layers with defects is discussed.


title: A topological fluctuation theorem

abstract: Fluctuation theorems specify the non-zero probability to observe negative entropy production, contrary to a naive expectation from the second law of thermodynamics. For closed particle trajectories in a fluid, Stokes theorem can be used to give a geometric characterization of the entropy production. Building on this picture, we formulate a topological fluctuation theorem that depends only by the winding number around each vortex core and is insensitive to other aspects of the force. The probability is robust to local deformations of the particle trajectory, reminiscent of topologically protected modes in various classical and quantum systems. We demonstrate that entropy production is quantized in these strongly fluctuating systems, and it is controlled by a topological invariant. We demonstrate that the theorem holds even when the probability distributions are non-Gaussian functions of the generated heat.


title: Global existence and decay of the inhomogeneous Muskat problem with Lipschitz initial data

abstract: In this work we study the inhomogeneous Muskat problem, \emph{i.e.} the evolution of an internal wave between two different fluids in a porous medium with discontinuous permeability. In particular, under precise conditions on the initial datum and the physical quantities of the problem, our results ensure the decay of the solutions towards the equilibrium state in the Lipschitz norm. In addition, we establish the global existence and decay of Lipschitz solutions.


title: Multi-lane Unsignalized Intersection Cooperation with Flexible Lane Direction based on Multi-vehicle Formation Control

abstract: Unsignalized intersection cooperation of connected and automated vehicles (CAVs) is able to eliminate green time loss of signalized intersections and improve traffic efficiency. Most of the existing research on unsignalized intersection cooperation considers fixed lane direction, where only specific turning behavior of vehicles is allowed on each lane. Given that traffic volume and the proportion of vehicles with different turning expectation may change with time, fixed lane direction may lead to inefficiency at intersections. This paper proposes a multi-lane unsignalized intersection cooperation method that considers flexible lane direction. The two-dimensional distribution of vehicles is calculated and vehicles that are not in conflict are scheduled to pass the intersection simultaneously. The formation reconfiguration method is utilized to achieve collision-free longitudinal and lateral position adjustment of vehicles. Simulations are conducted at different input traffic volumes and turning proportion of incoming vehicles, and the results indicate that our method outperformances the fixed-lane-direction unsignalized cooperation method and the signalized method.


title: Realization of a periodically driven open three-level Dicke model

abstract: A periodically driven open three-level Dicke model is realized by resonantly shaking the pump field in an atom-cavity system. As an unambiguous signature, we demonstrate the emergence of a dynamical phase, in which the atoms periodically localize between the antinodes of the pump lattice, associated with an oscillating net momentum along the pump axis. We observe this dynamical phase through the periodic switching of the relative phase between the pump and cavity fields at a small fraction of the driving frequency, suggesting that it exhibits a time crystalline character.


title: Quantum kernels with squeezed-state encoding for machine learning

abstract: Kernel methods are powerful for machine learning, as they can represent data in feature spaces that similarities between samples may be faithfully captured. Recently, it is realized that machine learning enhanced by quantum computing is closely related to kernel methods, where the exponentially large Hilbert space turns to be a feature space more expressive than classical ones. In this paper, we generalize quantum kernel methods by encoding data into continuous-variable quantum states, which can benefit from the infinite-dimensional Hilbert space of continuous variables. Specially, we propose squeezed-state encoding, in which data is encoded as either in the amplitude or the phase. The kernels can be calculated on a quantum computer and then are combined with classical machine learning, e.g. support vector machine, for training and predicting tasks. Their comparisons with other classical kernels are also addressed. Lastly, we discuss physical implementations of squeezed-state encoding for machine learning in quantum platforms such as trapped ions.


title: Correlation Differential Power Analysis Attack to Midori64

abstract: Today, Internet communication security has become more complex as technology becomes faster and more efficient, especially for resource-limited devices such as embedded devices, wireless sensors, and radio frequency identification (RFID) tags, and Internet of Things (IoT). Lightweight encryption algorithms provide security for these devices to protect data against intruders. But the limitation of using energy in lightweight block ciphers (LBCs) is one of the major challenges for ever-expanding IoT technologies. Also, these LBC are subject to Side-channel attacks, which are among the most cited threats to these ciphers. In this paper, a differential power attack (DPA) to the Midori64 block cipher is designed. According to the proposed method, an attack on the S-boxes of the first round is done to obtain half of the master key bits. Then, the S-boxes of the second round were attacked to obtain remaining the master key bits. The results confirmed that the key is ultimately obtained. With the low volume of computational complexity, we obtained the Midori block cipher key, which was considered secure, just by using 300 samples of the plaintext. Following the running of Midori64 on the AVR microcontroller of the Atmega32 model, the master key of Midori block cipher is discovered with 300 known texts. Furthermore, we obtained the master key with a smaller number of samples than the electromagnetic analysis attack.


title: TransFER: Learning Relation-aware Facial Expression Representations with Transformers

abstract: Facial expression recognition (FER) has received increasing interest in computer vision. We propose the TransFER model which can learn rich relation-aware local representations. It mainly consists of three components: Multi-Attention Dropping (MAD), ViT-FER, and Multi-head Self-Attention Dropping (MSAD). First, local patches play an important role in distinguishing various expressions, however, few existing works can locate discriminative and diverse local patches. This can cause serious problems when some patches are invisible due to pose variations or viewpoint changes. To address this issue, the MAD is proposed to randomly drop an attention map. Consequently, models are pushed to explore diverse local patches adaptively. Second, to build rich relations between different local patches, the Vision Transformers (ViT) are used in FER, called ViT-FER. Since the global scope is used to reinforce each local patch, a better representation is obtained to boost the FER performance. Thirdly, the multi-head self-attention allows ViT to jointly attend to features from different information subspaces at different positions. Given no explicit guidance, however, multiple self-attentions may extract similar relations. To address this, the MSAD is proposed to randomly drop one self-attention module. As a result, models are forced to learn rich relations among diverse local patches. Our proposed TransFER model outperforms the state-of-the-art methods on several FER benchmarks, showing its effectiveness and usefulness.


title: GlassNet: Label Decoupling-based Three-stream Neural Network for Robust Image Glass Detection

abstract: Most of the existing object detection methods generate poor glass detection results, due to the fact that the transparent glass shares the same appearance with arbitrary objects behind it in an image. Different from traditional deep learning-based wisdoms that simply use the object boundary as auxiliary supervision, we exploit label decoupling to decompose the original labeled ground-truth (GT) map into an interior-diffusion map and a boundary-diffusion map. The GT map in collaboration with the two newly generated maps breaks the imbalanced distribution of the object boundary, leading to improved glass detection quality. We have three key contributions to solve the transparent glass detection problem: (1) We propose a three-stream neural network (call GlassNet for short) to fully absorb beneficial features in the three maps. (2) We design a multi-scale interactive dilation module to explore a wider range of contextual information. (3) We develop an attention-based boundary-aware feature Mosaic module to integrate multi-modal information. Extensive experiments on the benchmark dataset exhibit clear improvements of our method over SOTAs, in terms of both the overall glass detection accuracy and boundary clearness.


title: Airplane Type Identification Based on Mask RCNN; An Approach to Reduce Airport Traffic Congestion

abstract: One of the most difficult jobs in remote sensing is dealing with traffic bottlenecks at airports. This fact has been confirmed by several studies attempting to resolve this issue. Among a wide range of approaches employed the most successful methods have been based on airplane object recognition using satellite images as datasets for deep learning models. Airplane object identification is not a viable method for resolving traffic congestion. There are several types of airplanes at the airport each with its own set of requirements and specifications.Utilizing satellite pictures will require the use of complex equipment which is a financial burden. In this work a universal low-cost and efficient solution for airport traffic congestion is proposed. Drone-captured aerial pictures are used to train and assess a Mask Region Convolution Neural Network model. This model can detect the presence of any aircraft in a photograph and pinpoint its location. It also includes mask estimations to properly identify each detected airplane type based on the estimated surface area and cabin length which are crucial variables in distinguishing planes. The study is conducted using Microsoft Common Object in Context COCO metrics average accuracies and a confusion matrix all of which demonstrate the approach's potential in providing valuable aid for dealing with traffic congestion at airports.


title: Product-oriented Machine Translation with Cross-modal Cross-lingual Pre-training

abstract: Translating e-commercial product descriptions, a.k.a product-oriented machine translation (PMT), is essential to serve e-shoppers all over the world. However, due to the domain specialty, the PMT task is more challenging than traditional machine translation problems. Firstly, there are many specialized jargons in the product description, which are ambiguous to translate without the product image. Secondly, product descriptions are related to the image in more complicated ways than standard image descriptions, involving various visual aspects such as objects, shapes, colors or even subjective styles. Moreover, existing PMT datasets are small in scale to support the research. In this paper, we first construct a large-scale bilingual product description dataset called Fashion-MMT, which contains over 114k noisy and 40k manually cleaned description translations with multiple product images. To effectively learn semantic alignments among product images and bilingual texts in translation, we design a unified product-oriented cross-modal cross-lingual model (\upoc~) for pre-training and fine-tuning. Experiments on the Fashion-MMT and Multi30k datasets show that our model significantly outperforms the state-of-the-art models even pre-trained on the same dataset. It is also shown to benefit more from large-scale noisy data to improve the translation quality. We will release the dataset and codes at https://github.com/syuqings/Fashion-MMT.


title: Binary fraction of O and B-type stars from LAMOST data

abstract: Binary stars plays important role in the evolution of stellar populations . The intrinsic binary fraction ($f_{bin}$) of O and B-type (OB) stars in LAMOST DR5 was investigated in this work. We employed a cross-correlation approach to estimate relative radial velocities for each of the stellar spectra. The algorithm described by \cite{2013A&A...550A.107S} was implemented and several simulations were made to assess the performance of the approach. Binary fraction of the OB stars are estimated through comparing the uni-distribution between observations and simulations with the Kolmogorov-Smirnov tests. Simulations show that it is reliable for stars most of whom have $6,7$ and $8$ repeated observations. The uncertainty of orbital parameters of binarity become larger when observational frequencies decrease. By adopting the fixed power exponents of $\pi=-0.45$ and $\kappa=-1$ for period and mass ratio distributions, respectively, we obtain that $f_{bin}=0.4_{-0.06}^{+0.05}$ for the samples with more than 3 observations. When we consider the full samples with at least 2 observations, the binary fraction turns out to be $0.37_{-0.03}^{+0.03}$. These two results are consistent with each other in $1\sigma$.


title: On the generalized Calder\'on formulas for closed- and open-surface elastic scattering problems

abstract: The Calder\'on formulas (i.e., the combination of single-layer and hyper-singular boundary integral operators) have been widely utilized in the process of constructing valid boundary integral equation systems which could possess highly favorable spectral properties. This work is devoted to studying the theoretical properties of elastodynamic Calder\'on formulas which provide us with a solid basis for the design of fast boundary integral equation methods solving elastic wave problems defined on a close-surface or an open-surface in two dimensions. For the closed-surface case, it is proved that the Calder\'on formula is a Fredholm operator of second-kind except for certain circumstances. Regarding to the open-surface case, we investigate weighted integral operators instead of the original integral operators which are resulted from dealing with edge singularities of potentials corresponding to the elastic scattering problems by open-surfaces, and show that the Calder\'on formula is a compact perturbation of a bounded and invertible operator. To complete the proof, we need to use the well-posedness result of the elastic scattering problem, the analysis of the zero-frequency integral operators defined on the straight arc, the singularity decompositions of the kernels of integral operators, and a new representation formula of the hyper-singular operator. Moreover, it can be demonstrated that the accumulation point of the spectrum of the invertible operator is the same as that of the eigenvalues of the Calder\'on formula in the closed-surface case.


title: Spatial Fuzzy Clustering on Synthetic Aperture Radar Images to Detect Changes

abstract: Data and data sources have become increasingly essential in recent decades. Scientists and researchers require more data to deploy AI approaches as the field continues to improve. In recent years, the rapid technological advancements have had a significant impact on human existence. One major field for collecting data is satellite technology. With the fast development of various satellite sensor equipment, synthetic aperture radar (SAR) images have become an important source of data for a variety of research subjects, including environmental studies, urban studies, coastal extraction, water sources, etc. Change detection and coastline detection are both achieved using SAR pictures. However, speckle noise is a major problem in SAR imaging. Several solutions have been offered to address this issue. One solution is to expose SAR images to spatial fuzzy clustering. Another solution is to separate speech. This study utilises the spatial function to overcome speckle noise and cluster the SAR images with the highest achieved accuracy. The spatial function is proposed in this work since the likelihood of data falling into one cluster is what this function is all about. When the spatial function is employed to cluster data in fuzzy logic, the clustering outcomes improve. The proposed clustering technique is us


title: A Bayesian Tensor Approach to Enable RIS for 6G Massive Unsourced Random Access

abstract: This paper investigates the problem of joint massive devices separation and channel estimation for a reconfigurable intelligent surface (RIS)-aided unsourced random access (URA) scheme in the sixth-generation (6G) wireless networks. In particular, by associating the data sequences to a rank-one tensor and exploiting the angular sparsity of the channel, the detection problem is cast as a high-order coupled tensor decomposition problem. However, the coupling among multiple devices to RIS (device-RIS) channels together with their sparse structure make the problem intractable. By devising novel priors to incorporate problem structures, we design a novel probabilistic model to capture both the element-wise sparsity from the angular channel model and the low rank property due to the sporadic nature of URA. Based on the this probabilistic model, we develop a coupled tensor-based automatic detection (CTAD) algorithm under the framework of variational inference with fast convergence and low computational complexity. Moreover, the proposed algorithm can automatically learn the number of active devices and thus effectively avoid noise overfitting. Extensive simulation results confirm the effectiveness and improvements of the proposed URA algorithm in large-scale RIS regime.


title: Inductive Matrix Completion Using Graph Autoencoder

abstract: Recently, the graph neural network (GNN) has shown great power in matrix completion by formulating a rating matrix as a bipartite graph and then predicting the link between the corresponding user and item nodes. The majority of GNN-based matrix completion methods are based on Graph Autoencoder (GAE), which considers the one-hot index as input, maps a user (or item) index to a learnable embedding, applies a GNN to learn the node-specific representations based on these learnable embeddings and finally aggregates the representations of the target users and its corresponding item nodes to predict missing links. However, without node content (i.e., side information) for training, the user (or item) specific representation can not be learned in the inductive setting, that is, a model trained on one group of users (or items) cannot adapt to new users (or items). To this end, we propose an inductive matrix completion method using GAE (IMC-GAE), which utilizes the GAE to learn both the user-specific (or item-specific) representation for personalized recommendation and local graph patterns for inductive matrix completion. Specifically, we design two informative node features and employ a layer-wise node dropout scheme in GAE to learn local graph patterns which can be generalized to unseen data. The main contribution of our paper is the capability to efficiently learn local graph patterns in GAE, with good scalability and superior expressiveness compared to previous GNN-based matrix completion methods. Furthermore, extensive experiments demonstrate that our model achieves state-of-the-art performance on several matrix completion benchmarks. Our official code is publicly available.


title: A New Insight on Augmented Lagrangian Method and Its Extensions

abstract: Motivated by the recent work [He-Yuan, Balanced Augmented Lagrangian Method for Convex Programming, arXiv: 2108.08554v1, (2021)], a novel Augmented Lagrangian Method (ALM) has been proposed for solving a family of convex optimization problem subject to equality or inequality constraint. This new method is then extended to solve the multi-block separable convex optimization problem, and two related primal-dual hybrid gradient algorithms are also discussed. Preliminary and some new convergence results are established with the aid of variational analysis for both the saddle point of the problem and the first-order optimality conditions of involved subproblems.


title: YANMTT: Yet Another Neural Machine Translation Toolkit

abstract: In this paper we present our open-source neural machine translation (NMT) toolkit called "Yet Another Neural Machine Translation Toolkit" abbreviated as YANMTT which is built on top of the Transformers library. Despite the growing importance of sequence to sequence pre-training there surprisingly few, if not none, well established toolkits that allow users to easily do pre-training. Toolkits such as Fairseq which do allow pre-training, have very large codebases and thus they are not beginner friendly. With regards to transfer learning via fine-tuning most toolkits do not explicitly allow the user to have control over what parts of the pre-trained models can be transferred. YANMTT aims to address these issues via the minimum amount of code to pre-train large scale NMT models, selectively transfer pre-trained parameters and fine-tune them, perform translation as well as extract representations and attentions for visualization and analyses. Apart from these core features our toolkit also provides other advanced functionalities such as but not limited to document/multi-source NMT, simultaneous NMT and model compression via distillation which we believe are relevant to the purpose behind our toolkit.


title: AutoShape: Real-Time Shape-Aware Monocular 3D Object Detection

abstract: Existing deep learning-based approaches for monocular 3D object detection in autonomous driving often model the object as a rotated 3D cuboid while the object's geometric shape has been ignored. In this work, we propose an approach for incorporating the shape-aware 2D/3D constraints into the 3D detection framework. Specifically, we employ the deep neural network to learn distinguished 2D keypoints in the 2D image domain and regress their corresponding 3D coordinates in the local 3D object coordinate first. Then the 2D/3D geometric constraints are built by these correspondences for each object to boost the detection performance. For generating the ground truth of 2D/3D keypoints, an automatic model-fitting approach has been proposed by fitting the deformed 3D object model and the object mask in the 2D image. The proposed framework has been verified on the public KITTI dataset and the experimental results demonstrate that by using additional geometrical constraints the detection performance has been significantly improved as compared to the baseline method. More importantly, the proposed framework achieves state-of-the-art performance with real time. Data and code will be available at https://github.com/zongdai/AutoShape


title: Semantic Scene Segmentation for Robotics Applications

abstract: Semantic scene segmentation plays a critical role in a wide range of robotics applications, e.g., autonomous navigation. These applications are accompanied by specific computational restrictions, e.g., operation on low-power GPUs, at sufficient speed, and also for high-resolution input. Existing state-of-the-art segmentation models provide evaluation results under different setups and mainly considering high-power GPUs. In this paper, we investigate the behavior of the most successful semantic scene segmentation models, in terms of deployment (inference) speed, under various setups (GPUs, input sizes, etc.) in the context of robotics applications. The target of this work is to provide a comparative study of current state-of-the-art segmentation models so as to select the most compliant with the robotics applications requirements.


title: Bogoliubov Theory for Trapped Bosons in the Gross-Pitaevskii Regime

abstract: We consider systems of $N$ bosons in $\mathbb{R}^3$, trapped by an external potential. The interaction is repulsive and has a scattering length of the order $N^{-1}$ (Gross-Pitaevskii regime). We determine the ground state energy and the low-energy excitation spectrum up to errors that vanish in the limit $N\to \infty$.


title: Constraints on accreting primordial black holes with the global 21-cm signal

abstract: We investigate the effect of accreting primordial black holes (PBHs) on the thermal history of the intergalactic medium (IGM), including the accretion of baryonic matter and dark matter particles. The variations of the thermal history of the IGM caused by accreting PBHs will result in the changes of the global 21-cm signal in the cosmic dawn. Based on the detection of the global 21-cm signal by EDGES, by requiring the differential brightness temperature, e.g., $\delta T_{21} \lesssim -100~(-50)~\rm mK$, we obtain the upper limits on the abundance of PBHs for the mass range $10\lesssim M_{\rm PBH} \lesssim 10^{4}~M_{\odot}$. Compared with previous works, the limits are stronger for the mass range $10\lesssim M_{\rm PBH}\lesssim 50~M_{\odot}$.


title: Mechanism of separation hysteresis in curved compression ramp

abstract: A new spatial-related mechanism is proposed to understand separation hysteresis processes in curved compression ramp (CCR) flows discovered recently (Hu et al. Phy. Fluid, 32(11): 113601, 2020). Two separation hystereses, induced by variations of Mach number and wall temperature, are investigated numerically. The two hystereses indicate that there must exist parameter intervals of Mach number and wall temperature, wherein both attachment and separation states can be established stably. The relationships between the aerodynamic characteristics (including wall friction, pressure and heat flux) and the shock wave configurations in this two hystereses are analyzed. Further, the adverse pressure gradient (APG) Isb(x) induced by the upstream separation process and APG Icw(x) induced by the downstream isentropic compression process are estimated by classic theories. The trend of boundary layer APG resistence Ib(x) is evaluated from the spatial distributions of the physical quantities such as the shape factor and the height of the sound velocity line. With the stable conditions of separation and attachment, a self-consistent mechanism is obtained when Isb, Icw and Ib have appropriate spatial distributions.


abstract: A lattice polytope translated by a rational vector is called an almost integral polytope. In this paper we investigate Ehrhart quasi-polynomials of almost integral polytopes. We study the relationship between the shape of the polytopes and algebraic properties of the Ehrhart quasi-polynomials. In particular, we prove that lattice zonotopes and centrally symmetric lattice polytopes are characterized by Ehrhart quasi-polynomials of their rational translations.


title: Effective surface energies in nematic liquid crystals as homogenised rugosity effects

abstract: We study the effect of boundary rugosity in nematic liquid crystalline systems. We consider a highly general formulation of the problem, able to simultaneously deal with several liquid crystal theories. We use techniques of Gamma convergence and demonstrate that the effect of fine-scale surface oscillations may be replaced by an effective homogenised surface energy on a simpler domain. The homogenisation limit is then quantitatively studied in a simplified setting, obtaining convergence rates.


title: Dynamics of large samples of repulsive Fermi gases at nonzero temperatures

abstract: We develop a model of a binary fermionic mixture, consisting of large number of atoms, applicable at nonzero temperatures, in the normal phase. We use this approach to study dynamics of degenerate Fermi systems under various perturbations. For example, we analyze spin-dipole oscillations of a two-component fermionic mixture, demonstrating that the ferromagnetic phase shows up at stronger repulsion between components while the temperature raises. We study as well the radial oscillations of weakly interacting repulsive Fermi gases. We obtain a good agreement with experimental data when available. Otherwise, we compare our results with the outcome of the Hartree-Fock orbital calculations done for the system with small number of fermions.


title: Bridged Adversarial Training

abstract: Adversarial robustness is considered as a required property of deep neural networks. In this study, we discover that adversarially trained models might have significantly different characteristics in terms of margin and smoothness, even they show similar robustness. Inspired by the observation, we investigate the effect of different regularizers and discover the negative effect of the smoothness regularizer on maximizing the margin. Based on the analyses, we propose a new method called bridged adversarial training that mitigates the negative effect by bridging the gap between clean and adversarial examples. We provide theoretical and empirical evidence that the proposed method provides stable and better robustness, especially for large perturbations.


title: Flexible terahertz opto-electronic frequency comb light source tunable over 3.5 THz

abstract: We demonstrate a terahertz (THz) frequency comb that is flexible in terms of its frequency range and the number and spacing of comb lines. We use a combination of near-infrared laser diodes, phase modulation and opto-electronic frequency conversion. The THz comb lines are characterized to be < 10 MHz by resolving the pressure dependent collisional broadening of an ammonia molecule rotational mode.


title: Some Notions of (Open) Dynamical System on Polynomial Interfaces

abstract: We define indexed categories of (open) dynamical system and random dynamical system over polynomial interfaces, where time is given by an arbitrary monoid $\mathbb{T}$. We consider the case of open random dynamical systems over both open and closed noise sources, and the case where the interface of the random system is `nested' over the interface of its noise source. We show that, in discrete time, our categories of dynamical systems over polynomial interfaces $p$ are equivalent to Spivak's categories $p$-$\mathbf{Coalg}$ of $p$-coalgebras. We then define a notion of generalized $pT$-coalgebra for a monad $T$, thereby extending the coalgebraic notion of dynamical system to general time, and show that this construction bestows a notion of open Markov process when the monad $T$ is a probability monad. Finally, we list some further connections and open questions.


title: Systematic generation of Hamiltonian families with dualities

abstract: Dualities are hidden symmetries that map seemingly unrelated physical systems onto each other. The goal of this work is to systematically construct families of Hamiltonians endowed with a given duality and to provide a universal description of Hamiltonians families near self-dual points. We focus on tight-binding models (also known as coupled-mode theories), which provide an effective description of systems composed of coupled harmonic oscillators across physical domains. We start by considering the general case in which group-theoretical arguments suffice to construct families of Hamiltonians with dualities by combining irreducible representations of the duality operation in parameter space and in operator space. When additional constraints due to system specific features are present, a purely group theoretic approach is no longer sufficient. To overcome this complication, we reformulate the existence of a duality as a minimization problem which is amenable to standard optimization and numerical continuation algorithms. Combined with existing procedures to physically implement coupled-resonator Hamiltonians, our approach enables on demand design of photonic, mechanical, thermal, or electronic metamaterials with dualities.

categories: physics.app-ph cond-mat.mes-hall cond-mat.soft physics.optics


title: Learning GraphQL Query Costs (Extended Version)

abstract: GraphQL is a query language for APIs and a runtime for executing those queries, fetching the requested data from existing microservices, REST APIs, databases, or other sources. Its expressiveness and its flexibility have made it an attractive candidate for API providers in many industries, especially through the web. A major drawback to blindly servicing a client's query in GraphQL is that the cost of a query can be unexpectedly large, creating computation and resource overload for the provider, and API rate-limit overages and infrastructure overload for the client. To mitigate these drawbacks, it is necessary to efficiently estimate the cost of a query before executing it. Estimating query cost is challenging, because GraphQL queries have a nested structure, GraphQL APIs follow different design conventions, and the underlying data sources are hidden. Estimates based on worst-case static query analysis have had limited success because they tend to grossly overestimate cost. We propose a machine-learning approach to efficiently and accurately estimate the query cost. We also demonstrate the power of this approach by testing it on query-response data from publicly available commercial APIs. Our framework is efficient and predicts query costs with high accuracy, consistently outperforming the static analysis by a large margin.


title: An ultra-stable microresonator-based electro-optic dual frequency comb

abstract: Optical frequency combs emit narrow pulses of light with a stable repetition rate. Equivalently, the generated light spectrum consists of many discrete frequencies spaced by this same repetition rate. These precision light sources have become ubiquitous in applications of photonic technologies because they allow coherent sampling over a broad part of the optical spectrum. The addition of another comb, with a slightly different line spacing, results in a dual comb. Widely used in spectroscopy, dual combs allow one to read out the broad frequency response of a sample in a simple electronic measurement. Many dual comb applications require a high level of mutual coherence between the combs, but achieving this stability can be demanding. Here, by exploiting the rich structure of the nonlinear electro-optic tensor in lithium niobate, we generate ultra-stable dual combs with the two combs naturally having orthogonal polarizations. Our combs have relative linewidths down to 400 microhertz, and require no stabilization or post-processing methods. The ultra-high stability of the spectrum emitted by our device, along with its simplicity of operation and energy efficiency, offer a route to the deployment of robust and versatile dual comb sources.