title: Revealing intrinsic superconductivity of the Nb/BiSbTe$_2$Se interface

abstract: Typically, topological superconductivity is reachable via proximity effect by a direct deposition of superconductor (S) on top of a topological insulator (TI) surface. Here we observed and analyzed the double critical current in the Josephson junctions based on the topological insulator in the fabricated planar Superconducting Quantum Interference Device. By measuring critical currents as a function of temperature and magnetic field, we show that the second critical current stems from the intrinsic superconductivity of the S/TI interface, which is supported by the modified Resistively Shunted Junction model and Transmission Electron Microscopy studies. This complex structure of the interface should be taken into account when technological process involves Ar-plasma cleaning.


title: Analytic continuations of the Horn $H_1$ and $H_5$ functions

abstract: The analytic continuations (ACs) of the double variable Horn $H_1$ and $H_5$ functions have been derived for the first time using the automated symbolic $\textit{Mathematica}$ package $\texttt{Olsson.wl}$. The use of Pfaff-Euler transformations have been emphasised to derive AC to cover regions which are otherwise not possible. The corresponding region of convergence (ROC) is obtained using its companion package $\texttt{ROC2.wl}$. A $\textit{Mathematica}$ package $\texttt{HornH1H5.wl}$, containing all the derived ACs and the associated ROCs, along with a demonstration file of the same is made publicly available in https://github.com/souvik5151/Horn_H1_H5 .


title: Partitioning a tournament into sub-tournaments of high connectivity

abstract: We prove that there exists a constant $c > 0$ such that the vertices of every strongly $c \cdot kt$-connected tournament can be partitioned into $t$ parts, each of which induces a strongly $k$-connected tournament. This is clearly tight up to a constant factor, and it confirms a conjecture of K\"uhn, Osthus and Townsend (2016).


title: Universal deformations of ideal liquid crystal elastomers

abstract: Liquid crystal elastomers are rubber-like solids with liquid crystalline mesogens (stiff, rod-like molecules) incorporated either into the main chain or as a side chain of the polymer. These solids display a range of unusual thermo-mechanical properties as a result of the coupling between the entropic elasticity of rubber and the orientational phase transitions of liquid crystals. One of these intriguing properties is the soft behavior, where it is able to undergo significant deformations with almost no stress. While the phenomenon is well-known, it has largely been examined in the context of homogenous deformations. This paper investigates soft behavior in complex inhomogeneous deformations. We model these materials as hyperelastic, isotropic, incompressible solids and exploit the seminal work of Ericksen, who established the existence of non-trivial universal deformations, those that satisfy the equations of equilibrium in every hyperelastic, isotropic, incompressible solid. We study the inflation of spherical and cylindrical balloons, cavitation and bending.


title: Assignment games with population monotonic allocation schemes

abstract: We characterize the assignment games which admit a population monotonic allocation scheme (PMAS) in terms of efficiently verifiable structural properties of the nonnegative matrix that induces the game. We prove that an assignment game is PMAS-admissible if and only if the positive elements of the underlying nonnegative matrix form orthogonal submatrices of three special types. In game theoretic terms it means that an assignment game is PMAS-admissible if and only if it contains a veto player or a dominant veto mixed pair or is composed of from these two types of special assignment games. We also show that in a PMAS-admissible assignment game all core allocations can be extended to a PMAS, and the nucleolus coincides with the tau-value.


title: Cylinder counts and spin refinement of area Siegel-Veech constants

abstract: We study the area Siegel-Veech constants of components of strata of abelian differentials with even or odd spin parity. We prove that these constants may be computed using either: (I) quasimodular forms, or (II) intersection theory. These results refine the main theorems of arXiv:1606.04065 and arXiv:1901.01785 which described the area Siegel-Veech constants of the full strata. Along the proof of (II), we establish a new identity for Siegel-Veech constants of cylinders.


title: ERL-Re$^2$: Efficient Evolutionary Reinforcement Learning with Shared State Representation and Individual Policy Representation

abstract: Deep Reinforcement Learning (Deep RL) and Evolutionary Algorithms (EA) are two major paradigms of policy optimization with distinct learning principles, i.e., gradient-based v.s. gradient-free. An appealing research direction is integrating Deep RL and EA to devise new methods by fusing their complementary advantages. However, existing works on combining Deep RL and EA have two common drawbacks: 1) the RL agent and EA agents learn their policies individually, neglecting efficient sharing of useful common knowledge; 2) parameter-level policy optimization guarantees no semantic level of behavior evolution for the EA side. In this paper, we propose Evolutionary Reinforcement Learning with Two-scale State Representation and Policy Representation (ERL-Re$^2$), a novel solution to the aforementioned two drawbacks. The key idea of ERL-Re$^2$ is two-scale representation: all EA and RL policies share the same nonlinear state representation while maintaining individual} linear policy representations. The state representation conveys expressive common features of the environment learned by all the agents collectively; the linear policy representation provides a favorable space for efficient policy optimization, where novel behavior-level crossover and mutation operations can be performed. Moreover, the linear policy representation allows convenient generalization of policy fitness with the help of the Policy-extended Value Function Approximator (PeVFA), further improving the sample efficiency of fitness estimation. The experiments on a range of continuous control tasks show that ERL-Re$^2$ consistently outperforms advanced baselines and achieves the State Of The Art (SOTA). Our code is available on https://github.com/yeshenpy/ERL-Re2.


title: SoK: Modeling Explainability in Security Analytics for Interpretability, Trustworthiness, and Usability

abstract: Interpretability, trustworthiness, and usability are key considerations in high-stake security applications, especially when utilizing deep learning models. While these models are known for their high accuracy, they behave as black boxes in which identifying important features and factors that led to a classification or a prediction is difficult. This can lead to uncertainty and distrust, especially when an incorrect prediction results in severe consequences. Thus, explanation methods aim to provide insights into the inner working of deep learning models. However, most explanation methods provide inconsistent explanations, have low fidelity, and are susceptible to adversarial manipulation, which can reduce model trustworthiness. This paper provides a comprehensive analysis of explainable methods and demonstrates their efficacy in three distinct security applications: anomaly detection using system logs, malware prediction, and detection of adversarial images. Our quantitative and qualitative analysis reveals serious limitations and concerns in state-of-the-art explanation methods in all three applications. We show that explanation methods for security applications necessitate distinct characteristics, such as stability, fidelity, robustness, and usability, among others, which we outline as the prerequisites for trustworthy explanation methods.


title: Enabling Atomic Durability for Persistent Memory with Transiently Persistent CPU Cache

abstract: Persistent memory (pmem) products bring the persistence domain up to the memory level. Intel recently introduced the eADR feature that guarantees to flush data buffered in CPU cache to pmem on a power outage, thereby making the CPU cache a transient persistence domain. Researchers have explored how to enable the atomic durability for applications' in-pmem data. In this paper, we exploit the eADR-supported CPU cache to do so. A modified cache line, until written back to pmem, is a natural redo log copy of the in-pmem data. However, a write-back due to cache replacement or eADR on a crash overwrites the original copy. We accordingly develop Hercules, a hardware logging design for the transaction-level atomic durability, with supportive components installed in CPU cache, memory controller (MC), and pmem. When a transaction commits, Hercules commits on-chip its data staying in cache lines. For cache lines evicted before the commit, Hercules asks the MC to redirect and persist them into in-pmem log entries and commits them off-chip upon committing the transaction. Hercules lazily conducts pmem writes only for cache replacements at runtime. On a crash, Hercules saves metadata and data for active transactions into pmem for recovery. Experiments show that, by using CPU cache for both buffering and logging, Hercules yields much higher throughput and incurs significantly fewer pmem writes than state-of-the-art designs.


title: Questioning the Validity of Summarization Datasets and Improving Their Factual Consistency

abstract: The topic of summarization evaluation has recently attracted a surge of attention due to the rapid development of abstractive summarization systems. However, the formulation of the task is rather ambiguous, neither the linguistic nor the natural language processing community has succeeded in giving a mutually agreed-upon definition. Due to this lack of well-defined formulation, a large number of popular abstractive summarization datasets are constructed in a manner that neither guarantees validity nor meets one of the most essential criteria of summarization: factual consistency. In this paper, we address this issue by combining state-of-the-art factual consistency models to identify the problematic instances present in popular summarization datasets. We release SummFC, a filtered summarization dataset with improved factual consistency, and demonstrate that models trained on this dataset achieve improved performance in nearly all quality aspects. We argue that our dataset should become a valid benchmark for developing and evaluating summarization systems.


title: Type I Shapovalov wave spacetimes in the Brans-Dicke scalar-tensor theory of gravity

abstract: Exact solutions for Shapovalov wave spacetimes of type I in the scalar-tensor theory of gravity of Brans-Dicke are constructed. Shapovalov's wave spacetimes describe gravitational-wave models that allow the separation of wave variables in privileged coordinate systems. In contrast to the general theory of relativity, the vacuum field equations of the Brans-Dicke scalar-tensor theory of gravity lead to exact solutions for type I Shapovalov spaces, which makes it possible to construct observational checks for detecting such wave disturbances. For the models under consideration, equations for the trajectories of test particles are obtained.


title: Stability of the cascading gauge theory de Sitter DFPs

abstract: We study stability of the Dynamical Fixed Points (DFPs) of the cascading gauge theory at strong coupling in de Sitter space-time. We compute the spectra of the perturbative fluctuations and identify stable/unstable DFPs, characterized by the ratio of the strong coupling scale $\Lambda$ of the gauge theory and the Hubble constant $H$ of the background space-time. We discover a new phenomenon in the spectrum of gravitational fluctuations of a non-conformal holographic model: distinct branches of the fluctuations for $H\gg \Lambda$ coalesce for sufficiently low $\frac{H}{\Lambda}$, leading to the removal of some excited modes from the spectrum. We establish that, at least in a dual supergravity approximation, cascading gauge theory does not have a stable DFP for $H\in (H_{crit_1},H_{crit_2})$. Initial states of the theory for $H>H_{crit_2}$ evolve to a stable DFP with unbroken chiral symmetry; while for $H< H_{crit_1}$ the states evolve to a de Sitter vacuum with spontaneously broken chiral symmetry.


title: Safe and Efficient Manoeuvring for Emergency Vehicles in Autonomous Traffic using Multi-Agent Proximal Policy Optimisation

abstract: Manoeuvring in the presence of emergency vehicles is still a major issue for vehicle autonomy systems. Most studies that address this topic are based on rule-based methods, which cannot cover all possible scenarios that can take place in autonomous traffic. Multi-Agent Proximal Policy Optimisation (MAPPO) has recently emerged as a powerful method for autonomous systems because it allows for training in thousands of different situations. In this study, we present an approach based on MAPPO to guarantee the safe and efficient manoeuvring of autonomous vehicles in the presence of an emergency vehicle. We introduce a risk metric that summarises the potential risk of collision in a single index. The proposed method generates cooperative policies allowing the emergency vehicle to go at $15 \%$ higher average speed while maintaining high safety distances. Moreover, we explore the trade-off between safety and traffic efficiency and assess the performance in a competitive scenario.


title: On D. Peterson's presentation of quantum cohomology of $G/P$

abstract: We prove in full generality that the $T$-equivariant quantum cohomology of any flag variety $G/P$ is isomorphic to the coordinate ring of a stratum of the Peterson scheme associated to the Langlands dual group scheme $G^{\vee}$. This result was discovered by Dale Peterson but remains unpublished. Our isomorphism is constructed using Yun-Zhu's isomorphism and Peterson-Lam-Shimozono's homomorphism.


title: Stochastic Geometric Mechanics in Nonequilibrium Thermodynamics: Schr\"odinger meets Onsager

abstract: We are describing relations between Schr\"odinger's variational problem and Onsager's approach to nonequilibrium statistical mechanics. Although the second work on reciprocal relations and detailed balance has been published in the same year (1931) as the first one, the impact of Schr\"odinger's idea has not yet been considered in the classical context of Onsager.

categories: cond-mat.stat-mech math-ph math.DG math.MP math.PR


title: A unified approach to informed trading via Monge-Kantorovich duality

abstract: We solve a generalized Kyle model type problem using Monge-Kantorovich duality and backward stochastic partial differential equations. First, we show that the the generalized Kyle model with dynamic information can be recast into a terminal optimization problem with distributional constraints. Therefore, the theory of optimal transport between spaces of unequal dimension comes as a natural tool. Second, the pricing rule of the market maker and an optimality criterion for the problem of the informed trader are established using the Kantorovich potentials and transport maps. Finally, we completely characterize the optimal strategies by analyzing the filtering problem from the market maker's point of view. In this context, the Kushner-Zakai filtering SPDE yields to an interesting backward stochastic partial differential equation whose measure-valued terminal condition comes from the optimal coupling of measures.


title: A high-order compact gas-kinetic scheme in a rotating coordinate frame and on sliding mesh

abstract: This paper extends the high-order compact gas-kinetic scheme (CGKS) to compressible flow simulations on a rotating coordinate frame. The kinetic equation with the inclusion of centrifugal and Coriolis acceleration is used in the construction of the scheme. With the updates of both cell averaged conservative variables and their gradients in the rotating and stationary domains, a third-order compact reconstruction is developed with sliding interface between them. To properly capture shock wave and complicated wave interaction, the HWENO-type non-linear reconstruction and gradient compression factors are incorporated in the scheme. For achieving high-order time accuracy, based on the flux function and its time derivative the multi-stage multi-derivative (MSMD) time stepping method is implemented in the scheme for the fourth-order accuracy with two stages. The CGKS is validated by many test cases from subsonic acoustic wave propagation to the high Mach number shock interaction in a rotating frame. The compact scheme achieves high-order accuracy and remarkable robustness.


title: Cooperative Sensing and Uploading for Quality-Cost Tradeoff of Digital Twins in VEC

abstract: Recent advances in sensing technologies, wireless communications, and computing paradigms drive the evolution of vehicles in becoming an intelligent and electronic consumer products. This paper investigates enabling digital twins in vehicular edge computing (DT-VEC) via cooperative sensing and uploading, and makes the first attempt to achieve the quality-cost tradeoff in DT-VEC. First, a DT-VEC architecture is presented, where the heterogeneous information can be sensed by vehicles and uploaded to the edge node via vehicle-to-infrastructure (V2I) communications. The digital twins are modeled based on the sensed information, which are utilized to from the logical view to reflect the real-time status of the physical vehicular environment. Second, we derive the cooperative sensing model and the V2I uploading model by considering the timeliness and consistency of digital twins, and the redundancy, sensing cost, and transmission cost. On this basis, a bi-objective problem is formulated to maximize the system quality and minimize the system cost. Third, we propose a solution based on multi-agent multi-objective (MAMO) deep reinforcement learning, where a dueling critic network is proposed to evaluate the agent action based on the value of state and the advantage of action. Finally, we give a comprehensive performance evaluation, demonstrating the superiority of MAMO.


title: Thick branes via higher order field theory models with exponential and power-law tails

abstract: In this work, we obtain exact thick brane models in $4+1$ dimensions generated by higher order field theory kinks, inspired by specific potentials for $\phi^{10}$ and $\phi^{18}$ models. We verify that the geodesic equation along the fifth dimension confirms the confining effects of the scalar field on the brane for all of these models. These models provide new solutions with exponential and power-law tails which live in different topological sectors. We show that the resulting branes of specific exponential law models do not possess $Z_2$-symmetry. Furthermore, we examine the stability of the thick branes, by determining the sign of the $w^2$ term in the expansion of the potential for the resulting Schr\"{o}dinger-like equation. It turns out that two of the three models of the $\phi^{10}$ brane are stable, while another contains unstable modes for certain ranges of the model parameters. We also show that the brane solution from the specific $\phi^{18}$ models are stable, while the others involve neutral equilibrium. The asymptotic behaviour of the brane solutions are also discussed.


title: Combining noisy well data and expert knowledge in a Bayesian calibration of a flow model under uncertainties: an application to solute transport in the Ticino basin

abstract: Groundwater flow modeling is commonly used to calculate groundwater heads, estimate groundwater flow paths and travel times, and provide insights into solute transport processes within an aquifer. However, the values of input parameters that drive groundwater flow models are often highly uncertain due to subsurface heterogeneity and geologic complexity in combination with lack of measurements/unreliable measurements. This uncertainty affects the accuracy and reliability of model outputs. Therefore, parameters' uncertainty must be quantified before adopting the model as an engineering tool. In this study, we model the uncertain parameters as random variables and use a Bayesian inversion approach to obtain a posterior,data-informed, probability density function (pdf) for them: in particular, the likelihood function we consider takes into account both well measurements and our prior knowledge about the extent of the springs in the domain under study. To keep the modelistic and computational complexities under control, we assume Gaussianity of the posterior pdf of the parameters. To corroborate this assumption, we run an identifiability analysis of the model: we apply the inversion procedure to several sets of synthetic data polluted by increasing levels of noise, and we determine at which levels of noise we can effectively recover the "true value" of the parameters. We then move to real well data (coming from the Ticino River basin, in northern Italy, and spanning a month in summer 2014), and use the posterior pdf of the parameters as a starting point to perform an Uncertainty Quantification analysis on groundwater travel-time distributions.


title: Zonal winds of Uranus and Neptune: Gravitational harmonics, dynamic self-gravity, shape, and rotation

abstract: Uranus and Neptune exhibit fast surface zonal winds that can reach up to few hundred meters per second. Previous studies on zonal gravitational harmonics and Ohmic dissipation constraints suggest that the wind speeds diminish rapidly in relatively shallow depths within the planets. Through a case-by-case comparison between the missing dynamical gravitational harmonic $J^\prime_4$ from structure models, and with that expected from fluid perturbations, we put constraints on zonal wind decay in Uranus and Neptune. To this end, we generate polytropic empirical structure models of Uranus and Neptune using $4^{\rm th}$-order Theory of Figures (ToF) that leave hydrostatic $J_4$ as an open parameter. Allotting the missing dynamical contribution to density perturbations caused by zonal winds (and their dynamic self-gravity), we find that the maximum scale height of zonal winds are $\sim 2-3\%$ of the planetary radii for both planets. Allowing the models to have $J_2$ solutions in the $\pm 5 \times 10^{-6}$ range around the observed value has similar implications. The effect of self-gravity on $J^\prime_4$ is roughly a factor of ten lower than that of zonal winds, as expected. The decay scale heights are virtually insensitive to the proposed modifications to the bulk rotation periods of Uranus and Neptune in the literature. Additionally, we find that the dynamical density perturbations due to zonal winds have a measurable impact on the shape of the planet, and could potentially be used to infer wind decay and bulk rotation period via future observations.


title: Latent Semantic Structure in Malicious Programs

abstract: Latent Semantic Analysis is a method of matrix decomposition used for discovering topics and topic weights in natural language documents. This study uses Latent Semantic Analysis to analyze the composition of binaries of malicious programs. The semantic representation of the term frequency vector representation yields a set of topics, each topic being a composition of terms. The vectors and topics were evaluated quantitatively using a spatial representation. This semantic analysis provides a more abstract representation of the program derived from its term frequency analysis. We use a metric space to represent a program as a collection of vectors, and a distance metric to evaluate their similarity within a topic. The segmentation of the vectors in this dataset provides increased resolution into the program structure.


title: A Cartesian graph-decomposition theorem based on a vertex-removing synchronised graph product

abstract: Recently, we have introduced and modified two graph-decomposition theorems based on a new graph product, motivated by applications in the context of synchronising periodic real-time processes. This vertex-removing synchronised product (VRSP), is based on modifications of the well-known Cartesian product and is closely related to the synchronised product due to W\"ohrle and Thomas. Here, we introduce a new graph-decomposition theorem based on the VRSP that provides a Cartesian decomposition of graphs.


title: On the Geometry Transferability of the Hybrid Iterative Numerical Solver for Differential Equations

abstract: The discovery of fast numerical solvers prompted a clear and rapid shift towards iterative techniques in many applications, especially in computational mechanics, due to the increased necessity for solving very large linear systems. Most numerical solvers are highly dependent on the problem geometry and discretization, facing issues when any of these properties change. The newly developed Hybrid Iterative Numerical Transferable Solver (HINTS) combines a standard solver with a neural operator to achieve better performance, focusing on a single geometry at a time. In this work, we explore the "T" in HINTS, i.e., the geometry transferability properties of HINTS. We first propose to directly employ HINTS built for a specific geometry to a different but related geometry without any adjustments. In addition, we propose the integration of an operator level transfer learning with HINTS to even further improve the convergence of HINTS on new geometries and discretizations. We conduct numerical experiments for a Darcy flow problem and a plane-strain elasticity problem. The results show that both the direct application of HINTS and the transfer learning enhanced HINTS are able to accurately solve these problems on different geometries. In addition, using transfer learning, HINTS is able to converge to machine zero even faster than the direct application of HINTS.


title: Probabilistic Decomposition Transformer for Time Series Forecasting

abstract: Time series forecasting is crucial for many fields, such as disaster warning, weather prediction, and energy consumption. The Transformer-based models are considered to have revolutionized the field of sequence modeling. However, the complex temporal patterns of the time series hinder the model from mining reliable temporal dependencies. Furthermore, the autoregressive form of the Transformer introduces cumulative errors in the inference step. In this paper, we propose the probabilistic decomposition Transformer model that combines the Transformer with a conditional generative model, which provides hierarchical and interpretable probabilistic forecasts for intricate time series. The Transformer is employed to learn temporal patterns and implement primary probabilistic forecasts, while the conditional generative model is used to achieve non-autoregressive hierarchical probabilistic forecasts by introducing latent space feature representations. In addition, the conditional generative model reconstructs typical features of the series, such as seasonality and trend terms, from probability distributions in the latent space to enable complex pattern separation and provide interpretable forecasts. Extensive experiments on several datasets demonstrate the effectiveness and robustness of the proposed model, indicating that it compares favorably with the state of the art.


title: Nondipole electron momentum offset as a probe of correlated three electron ionization in strongly driven atoms

abstract: We employ a recently developed three-dimensional semiclassical model to identify nondipole effects in triple ionization of Ne driven by infrared laser pulses at intensities where electron-electron correlation prevails. This model fully accounts for the Coulomb interaction of each electron with the core and avoids artificial autoionization by employing effective Coulomb potentials to describe the interaction between bound electrons (ECBB). Using the ECBB model, we identify a prominent signature of nondipole effects. Namely, the component along the direction of light propagation of the average sum of the final electron momenta is large and positive. That is, we identify a positive momentum offset, absent in the dipole approximation. We find that this positive momentum offset stems mostly from the momentum change due to the magnetic field. To further understand this momentum change, we also develop a simple model for the motion of an electron inside an electromagnetic field. This simple model accounts for the effect of the Coulomb forces only as a sharp change in the momentum of the electron during recollision. We show that the momentum change due to the magnetic field is related with the sharp change in momentum during recollision for the recolliding electron as well as with the time of recollision for both the recolliding and bound electrons. Hence, we demonstrate that the final electron momentum offset probes the strength of a recollision and hence the degree of correlation in multielectron ionization.


title: User Manual of Automatic Data Curation Tool(ADCT): A bulk data curator software in Library and Information Science

abstract: In library and information science, document storage and user-specific document retrieval are the main aspects of digital library services. To preserve the cultural heritage, documents, and literature, we need a common platform where all types of documents are available in a specific format. Our proposed software tool, ADCT can handle a bulk amount of data and transforms different types of raw data into specified metadata information. It generalizes multiple forms of curation logic applied to the source data. As state of the art, many research activities is done in various university to manage their research data in digital library services. The author provides descriptive statistics of library and information service (LIS) activities for information storage and retrieval. The paper shows research on methodology, information gathering, and scientific communication done on library data as an activity of the LIS community. The analysis of LIS data and the change of interest in information storage and retrieval from classification and indexing to retrieval are much important. For Building these types of digitized educational services, automatic data curation is an important stepping stone. The paper shows that automation can complement expertise and knowledge. The author builds an automated data transformation and curation tool that assists users in the analysis of metadata information and effort towards conforming to generic standards using a catalog when a librarian wants to see the adjacent related metadata for an archival collection of congressional correspondence.


title: Parametrizations of collinear and k_T-dependent parton densities in a proton

abstract: A new type of parametrization for parton distribution functions in a proton, based on their $Q^2$-evolution at large and small $x$ values, is constructed. In our analysis, the valence and nonsinglet parts obey the Gross-Llewellyn-Smith and Gottfried sum rules, respectively. For the singlet quark and gluon densities momentum conservation is taken into account. Then, using the Kimber-Martin-Ryskin prescription, we extend the consideration to Transverse Momentum Dependent (TMD, or unintegrated) gluon and quark distributions in a proton, which currently plays an important role in a number of phenomenological applications. The analytical expressions for the latter, valid for both low and large $x$, are derived for the first time.


title: Dependence of the electronic structure of $\beta$-Si$_{6-z}$Al$_{z}$O$_{z}$N$_{8-z}$ on the (Al,O) concentration $z$ and on the temperature

abstract: SiAlON is a prominent example of systems suitable as hosts for creating materials for light-emitting diodes (LEDs). In this work, the electronic structure of a series of semiordered and disordered SiAlON systems is investigated by means of ab initio calculations, using the FLAPW and Green function KKR methods. Finite temperature effects are included by averaging over thermodynamic configurations within the alloy analogy model. We found that the dependence of the electronic structure on the (Al,O) concentration $z$ is similar for semiordered and disordered structures. The electronic band gap decreases with increasing $z$ by about 1.5 eV when going from $z$=0 to $z$=2. States at the top of the valence band are mostly associated with N atoms whereas the states at the bottom of the conduction band are mostly derived from O~atoms. Increasing the temperature leads to a shift of the bottom of the conduction band to lower energies. The amount of this shift increases with increasing $z$.


title: Rethinking Generalization: The Impact of Annotation Style on Medical Image Segmentation

abstract: Generalization is an important attribute of machine learning models, particularly for those that are to be deployed in a medical context, where unreliable predictions can have real world consequences. While the failure of models to generalize across datasets is typically attributed to a mismatch in the data distributions, performance gaps are often a consequence of biases in the 'ground-truth' label annotations. This is particularly important in the context of medical image segmentation of pathological structures (e.g. lesions), where the annotation process is much more subjective, and affected by a number underlying factors, including the annotation protocol, rater education/experience, and clinical aims, among others. In this paper, we show that modeling annotation biases, rather than ignoring them, poses a promising way of accounting for differences in annotation style across datasets. To this end, we propose a generalized conditioning framework to (1) learn and account for different annotation styles across multiple datasets using a single model, (2) identify similar annotation styles across different datasets in order to permit their effective aggregation, and (3) fine-tune a fully trained model to a new annotation style with just a few samples. Next, we present an image-conditioning approach to model annotation styles that correlate with specific image features, potentially enabling detection biases to be more easily identified.


title: Do You Really Need to Disguise Normal Servers as Honeypots?

abstract: A honeypot, which is a kind of deception strategy, has been widely used for at least 20 years to mitigate cyber threats. Decision-makers have believed that honeypot strategies are intuitive and effective, since honeypots have successfully protected systems from Denial-of-Service (DoS) attacks to Advanced Persistent Threats (APT) in real-world cases. Nonetheless, there is a lack of research on the appropriate level of honeypot technique application to choose real-world operations. We examine and contrast three attack-defense games with respect to honeypot detection techniques in this paper. In particular, we specifically design and contrast two stages of honeypot technology one by one, starting with a game without deception. We demonstrate that the return for a defender using honeypots is higher than for a defender without them, albeit the defender may not always benefit financially from using more honeypot deception strategies. Particularly, disguising regular servers as honeypots does not provide defenders with a better reward. Furthermore, we take in consideration that fake honeypots can make maintaining normal nodes more costly. Our research offers a theoretical foundation for the real-world operator's decision of honeypot deception tactics and the required number of honeypot nodes.


title: Max Pooling with Vision Transformers reconciles class and shape in weakly supervised semantic segmentation

abstract: Weakly Supervised Semantic Segmentation (WSSS) research has explored many directions to improve the typical pipeline CNN plus class activation maps (CAM) plus refinements, given the image-class label as the only supervision. Though the gap with the fully supervised methods is reduced, further abating the spread seems unlikely within this framework. On the other hand, WSSS methods based on Vision Transformers (ViT) have not yet explored valid alternatives to CAM. ViT features have been shown to retain a scene layout, and object boundaries in self-supervised learning. To confirm these findings, we prove that the advantages of transformers in self-supervised methods are further strengthened by Global Max Pooling (GMP), which can leverage patch features to negotiate pixel-label probability with class probability. This work proposes a new WSSS method dubbed ViT-PCM (ViT Patch-Class Mapping), not based on CAM. The end-to-end presented network learns with a single optimization process, refined shape and proper localization for segmentation masks. Our model outperforms the state-of-the-art on baseline pseudo-masks (BPM), where we achieve $69.3\%$ mIoU on PascalVOC 2012 $val$ set. We show that our approach has the least set of parameters, though obtaining higher accuracy than all other approaches. In a sentence, quantitative and qualitative results of our method reveal that ViT-PCM is an excellent alternative to CNN-CAM based architectures.


title: TransEDRP: Dual Transformer model with Edge Emdedded for Drug Respond Prediction

abstract: GNN-based methods have achieved excellent results as a mainstream task in drug response prediction tasks in recent years. Traditional GNN methods use only the atoms in a drug molecule as nodes to obtain the representation of the molecular graph through node information passing, whereas the method using the transformer can only extract information about the nodes. However, the covalent bonding and chirality of a drug molecule have a great influence on the pharmacological properties of the molecule, and these information are implied in the chemical bonds formed by the edges between the atoms. In addition, CNN methods for modelling cell lines genomics sequences can only perceive local rather than global information about the sequence. In order to solve the above problems, we propose the decoupled dual transformer structure with edge embedded for drug respond prediction (TransEDRP), which is used for the representation of cell line genomics and drug respectively. For the drug branch, we encoded the chemical bond information within the molecule as the embedding of the edge in the molecular graph, extracted the global structural and biochemical information of the drug molecule using graph transformer. For the branch of cell lines genomics, we use the multi-headed attention mechanism to globally represent the genomics sequence. Finally, the drug and genomics branches are fused to predict IC50 values through the transformer layer and the fully connected layer, which two branches are different modalities. Extensive experiments have shown that our method is better than the current mainstream approach in all evaluation indicators.


title: The Executable Digital Twin: merging the digital and the physics worlds

abstract: While the digital twin has become an intrinsic part of the product creation process, its true power lies in the connectivity of the digital representation with its physical counterpart. Data acquired on the physical asset can validate, update and enrich the digital twin. The knowledge contained in the digital representation brings value to the physical asset itself. When a dedicated encapsulation is extracted from the digital twin to model a specific set of behaviors in a specific context, delivering a stand-alone executable representation, such instantiated and self-contained model is referred to as an Executable Digital Twin. In this contribution, key building blocks such as model order reduction, real-time models, state estimation and co-simulation are reviewed, and a number of characteristic use cases are presented. These include virtual sensing, hybrid testing and hardware-in-the loop, model-based control and model-based diagnostics.


title: Random Walk-based Community Key-members Search over Large Graphs

abstract: Given a graph $G$, a query node $q$, and an integer $k$, community search (CS) seeks a cohesive subgraph (measured by community models such as $k$-core or $k$-truss) from $G$ that contains $q$. It is difficult for ordinary users with less knowledge of graphs' complexity to set an appropriate $k$. Even if we define quite a large $k$, the community size returned by CS is often too large for users to gain much insight about it. Compared against the entire community, key-members in the community appear more valuable than others. To contend with this, we focus on Community Key-members Search problem (CKS). We turn our perspective to the key-members in the community containing $q$ instead of the entire community. To solve CKS problem, we first propose an exact algorithm based on truss decomposition as a baseline. Then, we present four random walk-based optimized algorithms to achieve a trade-off between effectiveness and efficiency, by carefully considering three important cohesiveness features in the design of transition matrix. As a result, we return key-members according to the stationary distribution when random walk converges. We theoretically analyze the rationality of designing the cohesiveness-aware transition matrix for random walk, through Bayesian theory based on Gaussian Mixture Model with Box-Cox Transformation and Copula Function Fitting. Moreover, we propose a lightweight refinement method following an ``expand-replace" manner to further optimize the result with little overhead, and we extend our method for CKS with multiple query nodes. Comprehensive experimental studies on various real-world datasets demonstrate our method's superiority.


title: A DFT+U type functional derived to explicitly address the flat plane condition

abstract: A new DFT+U type corrective functional is derived from first principles to enforce the flat plane condition on localized subspaces, thus dispensing with the need for an ad hoc derivation from the Hubbard model. The newly derived functional as given by equation 5 yields relative errors below 0.6% in the total energy of the dissociated s-block dimers as well as the dissociated H5+ ring system. In comparison bare PBE and PBE+U (using Dudarev's 1998 Hubbard functional) yields relative energetic errors as high as 8.0% and 20.5% respectively.

categories: cond-mat.str-el cond-mat.mtrl-sci physics.chem-ph physics.comp-ph quant-ph


title: Exact and Approximate Conformal Inference for Multi-Output Regression

abstract: It is common in machine learning to estimate a response $y$ given covariate information $x$. However, these predictions alone do not quantify any uncertainty associated with said predictions. One way to overcome this deficiency is with conformal inference methods, which construct a set containing the unobserved response $y$ with a prescribed probability. Unfortunately, even with a one-dimensional response, conformal inference is computationally expensive despite recent encouraging advances. In this paper, we explore multi-output regression, delivering exact derivations of conformal inference $p$-values when the predictive model can be described as a linear function of $y$. Additionally, we propose \texttt{unionCP} and a multivariate extension of \texttt{rootCP} as efficient ways of approximating the conformal prediction region for a wide array of multi-output predictors, both linear and nonlinear, while preserving computational advantages. We also provide both theoretical and empirical evidence of the effectiveness of these methods using both real-world and simulated data.

categories: stat.ML cs.LG math.ST stat.CO stat.OT stat.TH


title: Emergent Linguistic Structures in Neural Networks are Fragile

abstract: Large Language Models (LLMs) have been reported to have strong performance on natural language processing tasks. However, performance metrics such as accuracy do not measure the quality of the model in terms of its ability to robustly represent complex linguistic structures. In this paper, focusing on the ability of language models to represent syntax, we propose a framework to assess the consistency and robustness of linguistic representations. To this end, we introduce measures of robustness of neural network models that leverage recent advances in extracting linguistic constructs from LLMs via probing tasks, i.e., simple tasks used to extract meaningful information about a single facet of a language model, such as syntax reconstruction and root identification. Empirically, we study the performance of four LLMs across six different corpora on the proposed robustness measures by analysing their performance and robustness with respect to syntax-preserving perturbations. We provide evidence that context-free representation (e.g., GloVe) are in some cases competitive with context-dependent representations from modern LLMs (e.g., BERT), yet equally brittle to syntax-preserving perturbations. Our key observation is that emergent syntactic representations in neural networks are brittle. We make the code, trained models and logs available to the community as a contribution to the debate about the capabilities of LLMs.


title: Circuit Solutions towards Broadband Piezoelectric Energy Harvesting: An Impedance Analysis

abstract: In the studies of piezoelectric energy harvesting (PEH) systems, literature has shown that circuit advancement has a significant effect on the enhancement of energy harvesting capability in resonance. On the other hand, some recent studies using the phase-variable (PV) synchronized switch technologies have found that the advanced circuit solutions can also broaden the harvesting bandwidth. However, the available span of the electrically induced dynamics by the existing energy harvesting circuits was not properly defined and demonstrated. Performance comparison among different circuits cannot be fairly achieved without using a common theoretical language. Given these, this paper provides an impedance-based analysis and comparison on the electromechanical joint dynamics of the PEH systems using different interface circuits. Given that the resonance tunability by circuit solutions has received no attention in the conventional ideal model of kinetic energy harvester, we firstly propose a more inclusive ideal model for better generalization. In practice, it was proven that the attainable dynamic ranges of the practical energy harvesting circuits are only some subsets of the ideal realm. A detailed quantitative study on the attainable ranges of the PV circuit solutions is provided after the introduction of the ideal target. Simulation and experimental results of different interface circuits show good agreement with the theoretical analysis. It can be concluded that the resonance tunability strongly depends on the achievable extent in the reactive direction of the equivalent impedance plane. In practice, the electromechanical coupling conditions and dielectric loss might also influence the resonance tunability. The general ideal model and quantitative impedance analysis provided in this paper help guide the future design effort towards high-capability and broadband PEH systems.


title: Accelerating Diffusion Models via Pre-segmentation Diffusion Sampling for Medical Image Segmentation

abstract: Based on the Denoising Diffusion Probabilistic Model (DDPM), medical image segmentation can be described as a conditional image generation task, which allows to compute pixel-wise uncertainty maps of the segmentation and allows an implicit ensemble of segmentations to boost the segmentation performance. However, DDPM requires many iterative denoising steps to generate segmentations from Gaussian noise, resulting in extremely inefficient inference. To mitigate the issue, we propose a principled acceleration strategy, called pre-segmentation diffusion sampling DDPM (PD-DDPM), which is specially used for medical image segmentation. The key idea is to obtain pre-segmentation results based on a separately trained segmentation network, and construct noise predictions (non-Gaussian distribution) according to the forward diffusion rule. We can then start with noisy predictions and use fewer reverse steps to generate segmentation results. Experiments show that PD-DDPM yields better segmentation results over representative baseline methods even if the number of reverse steps is significantly reduced. Moreover, PD-DDPM is orthogonal to existing advanced segmentation models, which can be combined to further improve the segmentation performance.


title: Deep Model Reassembly

abstract: In this paper, we explore a novel knowledge-transfer task, termed as Deep Model Reassembly (DeRy), for general-purpose model reuse. Given a collection of heterogeneous models pre-trained from distinct sources and with diverse architectures, the goal of DeRy, as its name implies, is to first dissect each model into distinctive building blocks, and then selectively reassemble the derived blocks to produce customized networks under both the hardware resource and performance constraints. Such ambitious nature of DeRy inevitably imposes significant challenges, including, in the first place, the feasibility of its solution. We strive to showcase that, through a dedicated paradigm proposed in this paper, DeRy can be made not only possibly but practically efficiently. Specifically, we conduct the partitions of all pre-trained networks jointly via a cover set optimization, and derive a number of equivalence set, within each of which the network blocks are treated as functionally equivalent and hence interchangeable. The equivalence sets learned in this way, in turn, enable picking and assembling blocks to customize networks subject to certain constraints, which is achieved via solving an integer program backed up with a training-free proxy to estimate the task performance. The reassembled models, give rise to gratifying performances with the user-specified constraints satisfied. We demonstrate that on ImageNet, the best reassemble model achieves 78.6% top-1 accuracy without fine-tuning, which could be further elevated to 83.2% with end-to-end training. Our code is available at https://github.com/Adamdad/DeRy


title: A Python Framework for SPICE Circuit Simulation of In-Memory Analog Computing Circuits

abstract: With the increased attention to memristive-based in-memory analog computing (IMAC) architectures as an alternative for energy-hungry computer systems for data-intensive applications, a tool that enables exploring their device- and circuit-level design space can significantly boost the research and development in this area. Thus, in this paper, we develop IMAC-Sim, a circuit-level simulator for the design space exploration and multi-objective optimization of IMAC architectures. IMAC-Sim is a Python-based simulation framework, which creates the SPICE netlist of the IMAC circuit based on various device- and circuit-level hyperparameters selected by the user, and automatically evaluates the accuracy, power consumption and latency of the developed circuit using a user-specified dataset. IMAC-Sim simulates the interconnect parasitic resistance and capacitance in the IMAC architectures, and is also equipped with horizontal and vertical partitioning techniques to surmount these reliability challenges. In this abstract, we perform controlled experiments to exhibit some of the important capabilities of the IMAC-Sim.


title: Offset-Guided Attention Network for Room-Level Aware Floor Plan Segmentation

abstract: Recognition of floor plans has been a challenging and popular task. Despite that many recent approaches have been proposed for this task, they typically fail to make the room-level unified prediction. Specifically, multiple semantic categories can be assigned in a single room, which seriously limits their visual quality and applicability. In this paper, we propose a novel approach to recognize the floor plan layouts with a newly proposed Offset-Guided Attention mechanism to improve the semantic consistency within a room. In addition, we present a Feature Fusion Attention module that leverages the channel-wise attention to encourage the consistency of the room, wall, and door predictions, further enhancing the room-level semantic consistency. Experimental results manifest our approach is able to improve the room-level semantic consistency and outperforms the existing works both qualitatively and quantitatively.


title: Adversarial Domain Adaptation for Action Recognition Around the Clock

abstract: Due to the numerous potential applications in visual surveillance and nighttime driving, recognizing human action in low-light conditions remains a difficult problem in computer vision. Existing methods separate action recognition and dark enhancement into two distinct steps to accomplish this task. However, isolating the recognition and enhancement impedes end-to-end learning of the space-time representation for video action classification. This paper presents a domain adaptation-based action recognition approach that uses adversarial learning in cross-domain settings to learn cross-domain action recognition. Supervised learning can train it on a large amount of labeled data from the source domain (daytime action sequences). However, it uses deep domain invariant features to perform unsupervised learning on many unlabelled data from the target domain (night-time action sequences). The resulting augmented model, named 3D-DiNet can be trained using standard backpropagation with an additional layer. It achieves SOTA performance on InFAR and XD145 actions datasets.


title: Asymptotic properties of solutions to a certain ultrahyperbolic equation

abstract: We consider a certain ultrahyperbolic equation in a Euclidean space being a generalization of Klein-Gordon-Fock equation. The behavior of solutions at points tending to infinity along timelike directions is studied. We examine the issue of existence of solutions possessing given asymptotic properties at infinity.


title: An Industrial Workplace Alerting and Monitoring Platform to Prevent Workplace Injury and Accidents

abstract: Workplace accidents are a critical problem that causes many deaths, injuries, and financial losses. Climate change has a severe impact on industrial workers, partially caused by global warming. To reduce such casualties, it is important to proactively find unsafe environments where injuries could occur by detecting the use of personal protective equipment (PPE) and identifying unsafe activities. Thus, we propose an industrial workplace alerting and monitoring platform to detect PPE use and classify unsafe activity in group settings involving multiple humans and objects over a long period of time. Our proposed method is the first to analyze prolonged actions involving multiple people or objects. It benefits from combining pose estimation with PPE detection in one platform. Additionally, we propose the first open source annotated data set with video data from industrial workplaces annotated with the action classifications and detected PPE. The proposed system can be implemented within the surveillance cameras already present in industrial settings, making it a practical and effective solution.


title: ProbNeRF: Uncertainty-Aware Inference of 3D Shapes from 2D Images

abstract: The problem of inferring object shape from a single 2D image is underconstrained. Prior knowledge about what objects are plausible can help, but even given such prior knowledge there may still be uncertainty about the shapes of occluded parts of objects. Recently, conditional neural radiance field (NeRF) models have been developed that can learn to infer good point estimates of 3D models from single 2D images. The problem of inferring uncertainty estimates for these models has received less attention. In this work, we propose probabilistic NeRF (ProbNeRF), a model and inference strategy for learning probabilistic generative models of 3D objects' shapes and appearances, and for doing posterior inference to recover those properties from 2D images. ProbNeRF is trained as a variational autoencoder, but at test time we use Hamiltonian Monte Carlo (HMC) for inference. Given one or a few 2D images of an object (which may be partially occluded), ProbNeRF is able not only to accurately model the parts it sees, but also to propose realistic and diverse hypotheses about the parts it does not see. We show that key to the success of ProbNeRF are (i) a deterministic rendering scheme, (ii) an annealed-HMC strategy, (iii) a hypernetwork-based decoder architecture, and (iv) doing inference over a full set of NeRF weights, rather than just a low-dimensional code.


title: Efficient Similarity-based Passive Filter Pruning for Compressing CNNs

abstract: Convolution neural networks (CNNs) have shown great success in various applications. However, the computational complexity and memory storage of CNNs is a bottleneck for their deployment on resource-constrained devices. Recent efforts towards reducing the computation cost and the memory overhead of CNNs involve similarity-based passive filter pruning methods. Similarity-based passive filter pruning methods compute a pairwise similarity matrix for the filters and eliminate a few similar filters to obtain a small pruned CNN. However, the computational complexity of computing the pairwise similarity matrix is high, particularly when a convolutional layer has many filters. To reduce the computational complexity in obtaining the pairwise similarity matrix, we propose to use an efficient method where the complete pairwise similarity matrix is approximated from only a few of its columns by using a Nystr\"om approximation method. The proposed efficient similarity-based passive filter pruning method is 3 times faster and gives same accuracy at the same reduction in computations for CNNs compared to that of the similarity-based pruning method that computes a complete pairwise similarity matrix. Apart from this, the proposed efficient similarity-based pruning method performs similarly or better than the existing norm-based pruning methods. The efficacy of the proposed pruning method is evaluated on CNNs such as DCASE 2021 Task 1A baseline network and a VGGish network designed for acoustic scene classification.


title: Fashion-Specific Attributes Interpretation via Dual Gaussian Visual-Semantic Embedding

abstract: Several techniques to map various types of components, such as words, attributes, and images, into the embedded space have been studied. Most of them estimate the embedded representation of target entity as a point in the projective space. Some models, such as Word2Gauss, assume a probability distribution behind the embedded representation, which enables the spread or variance of the meaning of embedded target components to be captured and considered in more detail. We examine the method of estimating embedded representations as probability distributions for the interpretation of fashion-specific abstract and difficult-to-understand terms. Terms, such as "casual," "adult-casual,'' "beauty-casual," and "formal," are extremely subjective and abstract and are difficult for both experts and non-experts to understand, which discourages users from trying new fashion. We propose an end-to-end model called dual Gaussian visual-semantic embedding, which maps images and attributes in the same projective space and enables the interpretation of the meaning of these terms by its broad applications. We demonstrate the effectiveness of the proposed method through multifaceted experiments involving image and attribute mapping, image retrieval and re-ordering techniques, and a detailed theoretical/analytical discussion of the distance measure included in the loss function.


title: Controllable Factuality in Document-Grounded Dialog Systems Using a Noisy Channel Model

abstract: In this work, we present a model for document-grounded response generation in dialog that is decomposed into two components according to Bayes theorem. One component is a traditional ungrounded response generation model and the other component models the reconstruction of the grounding document based on the dialog context and generated response. We propose different approximate decoding schemes and evaluate our approach on multiple open-domain and task-oriented document-grounded dialog datasets. Our experiments show that the model is more factual in terms of automatic factuality metrics than the baseline model. Furthermore, we outline how introducing scaling factors between the components allows for controlling the tradeoff between factuality and fluency in the model output. Finally, we compare our approach to a recently proposed method to control factuality in grounded dialog, CTRL (arXiv:2107.06963), and show that both approaches can be combined to achieve additional improvements.


title: Impact of PolSAR pre-processing and balancing methods on complex-valued neural networks segmentation tasks

abstract: In this paper, we investigated the semantic segmentation of Polarimetric Synthetic Aperture Radar (PolSAR) using Complex-Valued Neural Network (CVNN). Although the coherency matrix is more widely used as the input of CVNN, the Pauli vector has recently been shown to be a valid alternative. We exhaustively compare both methods for six model architectures, three complex-valued, and their respective real-equivalent models. We are comparing, therefore, not only the input representation impact but also the complex- against the real-valued models. We then argue that the dataset splitting produces a high correlation between training and validation sets, saturating the task and thus achieving very high performance. We, therefore, use a different data pre-processing technique designed to reduce this effect and reproduce the results with the same configurations as before (input representation and model architectures). After seeing that the performance per class is highly different according to class occurrences, we propose two methods for reducing this gap and performing the results for all input representations, models, and dataset pre-processing.


title: Digital twins of physical printing-imaging channel

abstract: In this paper, we address the problem of modeling a printing-imaging channel built on a machine learning approach a.k.a. digital twin for anti-counterfeiting applications based on copy detection patterns (CDP). The digital twin is formulated on an information-theoretic framework called Turbo that uses variational approximations of mutual information developed for both encoder and decoder in a two-directional information passage. The proposed model generalizes several state-of-the-art architectures such as adversarial autoencoder (AAE), CycleGAN and adversarial latent space autoencoder (ALAE). This model can be applied to any type of printing and imaging and it only requires training data consisting of digital templates or artworks that are sent to a printing device and data acquired by an imaging device. Moreover, these data can be paired, unpaired or hybrid paired-unpaired which makes the proposed architecture very flexible and scalable to many practical setups. We demonstrate the impact of various architectural factors, metrics and discriminators on the overall system performance in the task of generation/prediction of printed CDP from their digital counterparts and vice versa. We also compare the proposed system with several state-of-the-art methods used for image-to-image translation applications.


title: I am Only Happy When There is Light: The Impact of Environmental Changes on Affective Facial Expressions Recognition

abstract: Human-robot interaction (HRI) benefits greatly from advances in the machine learning field as it allows researchers to employ high-performance models for perceptual tasks like detection and recognition. Especially deep learning models, either pre-trained for feature extraction or used for classification, are now established methods to characterize human behaviors in HRI scenarios and to have social robots that understand better those behaviors. As HRI experiments are usually small-scale and constrained to particular lab environments, the questions are how well can deep learning models generalize to specific interaction scenarios, and further, how good is their robustness towards environmental changes? These questions are important to address if the HRI field wishes to put social robotic companions into real environments acting consistently, i.e. changing lighting conditions or moving people should still produce the same recognition results. In this paper, we study the impact of different image conditions on the recognition of arousal and valence from human facial expressions using the FaceChannel framework \cite{Barro20}. Our results show how the interpretation of human affective states can differ greatly in either the positive or negative direction even when changing only slightly the image properties. We conclude the paper with important points to consider when employing deep learning models to ensure sound interpretation of HRI experiments.


title: Gravitational wave memory produced by cosmic background radiation

abstract: It is well known that energy fluxes will produce gravitational wave memory. The gravitational wave memory produced by background including cosmic microwave background (CMB), cosmic neutrino background (C$\nu$B), and gravitational wave background is investigated in this work. We construct a theory relating the gravitational wave memory strength to the energy flux of a stochastic background. We find that the resulted gravitational wave memory behaves as a constantly varying metric tensor. Such a varying metric tensor will introduce a quadrupole structure to the universe expansion. The gravitational wave memory due to the CMB is too small to be detected. But the gravitational wave memory due to the C$\nu$B and the gravitational wave background is marginally detectable. Interestingly, such detection can be used to estimate the neutrino masses and the properties of the gravitational wave background.


title: Symmetry-broken perturbation theory to large orders in antiferromagnetic phases

abstract: We introduce a spin-symmetry-broken extension of the connected determinant algorithm [Phys. Rev. Lett. 119, 045701 (2017)]. The resulting systematic perturbative expansions around an antiferromagnetic state allow for numerically exact calculations directly inside a magnetically ordered phase. We show new precise results for the magnetic phase diagram and thermodynamics of the three-dimensional cubic Hubbard model at half-filling. With detailed computations of the order parameter in the low to intermediate-coupling regime, we establish the N{\'e}el phase boundary. The critical behavior in its vicinity is shown to be compatible with the $O(3)$ Heisenberg universality class. By determining the evolution of the entropy with decreasing temperature through the phase transition we identify the different physical regimes at $U/t\!=\!4$. We provide quantitative results for several thermodynamic quantities deep inside the antiferromagnetic dome up to large interaction strengths and investigate the crossover between the Slater and Heisenberg regimes.


title: Tree Detection and Diameter Estimation Based on Deep Learning

abstract: Tree perception is an essential building block toward autonomous forestry operations. Current developments generally consider input data from lidar sensors to solve forest navigation, tree detection and diameter estimation problems. Whereas cameras paired with deep learning algorithms usually address species classification or forest anomaly detection. In either of these cases, data unavailability and forest diversity restrain deep learning developments for autonomous systems. So, we propose two densely annotated image datasets - 43k synthetic, 100 real - for bounding box, segmentation mask and keypoint detections to assess the potential of vision-based methods. Deep neural network models trained on our datasets achieve a precision of 90.4% for tree detection, 87.2% for tree segmentation, and centimeter accurate keypoint estimations. We measure our models' generalizability when testing it on other forest datasets, and their scalability with different dataset sizes and architectural improvements. Overall, the experimental results offer promising avenues toward autonomous tree felling operations and other applied forestry problems. The datasets and pre-trained models in this article are publicly available on \href{https://github.com/norlab-ulaval/PercepTreeV1}{GitHub} (https://github.com/norlab-ulaval/PercepTreeV1).


title: Algebraic Convolutional Filters on Lie Group Algebras

abstract: Group convolutional neural networks are a useful tool for utilizing symmetries known to be in a signal; however, they require that the signal is defined on the group itself. Existing approaches either work directly with group signals, or they impose a lifting step with heuristics to compute the convolution which can be computationally costly. Taking an algebraic signal processing perspective, we propose a novel convolutional filter from the Lie group algebra directly, thereby removing the need to lift altogether. Furthermore, we establish stability of the filter by drawing connections to multigraph signal processing. The proposed filter is evaluated on a classification problem on two datasets with $SO(3)$ group symmetries.


title: Trade-off Between Efficiency and Consistency for Removal-based Explanations

abstract: In the current landscape of explanation methodologies, most predominant approaches, such as SHAP and LIME, employ removal-based techniques to evaluate the impact of individual features by simulating various scenarios with specific features omitted. Nonetheless, these methods primarily emphasize efficiency in the original context, often resulting in general inconsistencies. In this paper, we demonstrate that such inconsistency is an inherent aspect of these approaches by establishing the Impossible Trinity Theorem, which posits that interpretability, efficiency, and consistency cannot hold simultaneously. Recognizing that the attainment of an ideal explanation remains elusive, we propose the utilization of interpretation error as a metric to gauge inefficiencies and inconsistencies. To this end, we present two novel algorithms founded on the standard polynomial basis, aimed at minimizing interpretation error. Our empirical findings indicate that the proposed methods achieve a substantial reduction in interpretation error, up to 31.8 times lower when compared to alternative techniques. Code is available at https://github.com/trusty-ai/efficient-consistent-explanations.


title: Existence and local uniqueness of multi-peak solutions for the Chern-Simons-Schr\"{o}dinger system

abstract: In the present paper, we consider the Chern-Simons-Schr\"{o}dinger system \begin{equation} \left\{ \begin{aligned} &-\varepsilon^{2}\Delta u+V(x)u+(A_{0}+A_{1}^{2}+A_{2}^{2})u=|u|^{p-2}u,\,\,\,\,x\in \mathbb{R}^2,\\ &\partial_1 A_0 = A_2 u^2,\ \partial_{2}A_{0}=-A_{1}u^{2},\\ &\partial_{1}A_{2}-\partial_{2}A_{1}=-\frac{1}{2}|u|^{2},\ \partial_{1}A_{1}+\partial_{2}A_{2}=0,\\ \end{aligned} \right. \end{equation} where $p>2,$ $\varepsilon>0$ is a parameter and $V:\mathbb{R}^{2}\rightarrow\mathbb{R}$ is a bounded continuous function. Under some mild assumptions on $V(x)$, we show the existence and local uniqueness of positive multi-peak solutions. Our methods mainly use the finite dimensional reduction method, various local Pohozaev identities, blow-up analysis and the maximum principle. Because of the nonlocal terms involved by $A_{0},A_{1}$ and $A_{2},$ we have to obtain a series of new and technical estimates.


title: EC-MOF/Phase-I: A computationally ready database of electrically conductive metal-organic frameworks with high-throughput structural and electronic properties

abstract: The advent of pi-stacked layered metal-organic frameworks (MOFs) opened up new horizons for designing compact MOF-based devices as they offer unique electrical conductivity on top of permanent porosity and exceptionally high surface area. By taking advantage of the modular nature of these electrically conductive (EC) MOFs, an unlimited number of materials can be created for applications in electronic devices such as battery electrodes, supercapacitors, and spintronics. Permutation of structural building blocks including different metal nodes and organic linkers results in new systems with unprecedented and unexplored physical and chemical properties. With the ultimate goal of providing a platform for accelerated materials design and discovery, here, we lay the foundations towards creation of the first comprehensive database of EC-MOFs with an experimentally guided approach. The first phase of this database, coined EC-MOF/Phase-I, is comprised of 1,061 bulk and mono-layer structures built by all possible combinations of experimentally reported organic linkers, functional groups and metal nodes. A high-throughput screening (HTS) work flow is constructed to implement density functional theory calculations with periodic boundary conditions to optimize the structures and calculate some of their most significantly relevant properties. Since research and development in the area of EC-MOFs has long been suffering from the lack of appropriate initial crystal structures, all the geometries and property data have been made available for the use of the community through the online platform that is developed in the course of this work. This database provides comprehensive physical and chemical data of EC-MOFs as well as convenience of selecting appropriate materials for specific applications, thus, accelerating design and discovery of EC-MOF-based compact devices.


title: The power of the Binary Value Principle

abstract: The (extended) Binary Value Principle (eBVP: $\sum_{i=1}^n x_i2^{i-1} = -k$ for $k>0$ and $x^2_i=x_i$) has received a lot of attention recently, several lower bounds have been proved for it (Alekseev et al 2020, Alekseev 2021, Part and Tzameret 2021). Also it has been shown (Alekseev et al 2020) that the probabilistically verifiable Ideal Proof System (IPS) (Grochow and Pitassi 2018) together with eBVP polynomially simulates a similar semialgebraic proof system. In this paper we consider Polynomial Calculus with the algebraic version of Tseitin's extension rule (Ext-PC). Contrary to IPS, this is a Cook--Reckhow proof system. We show that in this context eBVP still allows to simulate similar semialgebraic systems. We also prove that it allows to simulate the Square Root Rule (Grigoriev and Hirsch 2003), which is in sharp contrast with the result of (Alekseev 2021) that shows an exponential lower bound on the size of Ext-PC derivations of the Binary Value Principle from its square. On the other hand, we demonstrate that eBVP probably does not help in proving exponential lower bounds for Boolean formulas: we show that an Ext-PC (even with the Square Root Rule) derivation of any unsatisfiable Boolean formula in CNF from eBVP must be of exponential size.


title: Unstructured Grid Dynamical Modeling of Planetary Atmospheres using planetMPAS: The Influence of the Rigid Lid, Computational Efficiency, and Examples of Martian and Jovian Application

abstract: We present a new planetary global circulation model, planetMPAS, based on the state-of-the-art NCAR MPAS General Circulation Model. Taking advantage of the cross compatibility between WRF and MPAS, planetMPAS includes most of the planetWRF physics parameterization schemes for terrestrial planets such as Mars and Titan. PlanetMPAS also includes a set of physics that represents radiative transfer, dry convection, moist convection and its associated microphysics for the Jovian atmosphere. We demonstrate that, despite the rigid-lid approximation, planetMPAS is suitable to simulate the climate systems in Martian and Jovian atmospheres with potential application to slow-rotating planets such as Titan. Simulations using planetMPAS show that the new model can reproduce many aspects of the observed features on Mars and Jupiter, such as the seasonal CO2 cycle, polar argon enrichment, zonal mean temperature, and qualitative dust opacity on Mars, as well as the equatorial superrotation and banded zonal wind patterns on Jupiter.


title: A proton-recoil track imaging system for fast neutrons: the RIPTIDE detector

abstract: Fast neutron detection is often based on the neutron-proton elastic scattering reaction: the ionization caused by recoil protons in a hydrogenous material constitutes the basic information for the design and development of a class of neutron detectors. Although experimental techniques have continuously improved, proton-recoil track imaging remains still at the frontier of n-detection systems, due to the high photon sensitivity required. Several state-of-the-art approaches for neutron tracking by using n-p single and double scattering - referred to as Recoil Proton Track Imaging (RPTI) - can be found in the literature. So far, they have showed limits in terms of detection efficiency, complexity, cost, and implementation. In order to address some of these deficiencies, we have proposed RIPTIDE a novel recoil-proton track imaging detector in which the light output produced by a fast scintillator is used to perform a complete reconstruction in space and time of the interaction events. The proposed idea is viable thanks to the dramatic advances in low noise and single photon counting achieved in the last decade by new scientific CMOS cameras as well as pixel sensors, like Timepix or MIMOSIS. In this contribution, we report the advances on the RIPTIDE concept: Geant4 Monte Carlo simulations, light collection tests as well as state-of-the-art approach to image readout, processing and fast analysis.


title: SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Control

abstract: Despite the growing success of diffusion models in continuous-valued domains (e.g., images), similar efforts for discrete domains such as text have yet to match the performance of autoregressive language models. In this work, we present SSD-LM -- a diffusion-based language model with two key design choices. First, SSD-LM is semi-autoregressive, iteratively generating blocks of text, allowing for flexible output length at decoding time while enabling local bidirectional context updates. Second, it is simplex-based, performing diffusion on the natural vocabulary space rather than a learned latent space, allowing us to incorporate classifier guidance and modular control using off-the-shelf classifiers without any adaptation. We evaluate SSD-LM on unconstrained text generation benchmarks, and show that it matches or outperforms strong autoregressive GPT-2 models across standard quality and diversity metrics, while vastly outperforming diffusion-based baselines. On controlled text generation, SSD-LM also outperforms competitive baselines, with an extra advantage in modularity.


title: Enabling the discovery of fast transients: A kilonova science module for the Fink broker

abstract: We describe the fast transient classification algorithm in the center of the kilonova (KN) science module currently implemented in the Fink broker and report classification results based on simulated catalogs and real data from the ZTF alert stream. We used noiseless, homogeneously sampled simulations to construct a basis of principal components (PCs). All light curves from a more realistic ZTF simulation were written as a linear combination of this basis. The corresponding coefficients were used as features in training a random forest classifier. The same method was applied to long (>30 days) and medium (<30 days) light curves. The latter aimed to simulate the data situation found within the ZTF alert stream. Classification based on long light curves achieved 73.87% precision and 82.19% recall. Medium baseline analysis resulted in 69.30% precision and 69.74% recall, thus confirming the robustness of precision results when limited to 30 days of observations. In both cases, dwarf flares and point Type Ia supernovae were the most frequent contaminants. The final trained model was integrated into the Fink broker and has been distributing fast transients, tagged as KN_candidates, to the astronomical community, especially through the GRANDMA collaboration. We showed that features specifically designed to grasp different light curve behaviors provide enough information to separate fast (KN-like) from slow (non-KN-like) evolving events. This module represents one crucial link in an intricate chain of infrastructure elements for multi-messenger astronomy which is currently being put in place by the Fink broker team in preparation for the arrival of data from the Vera Rubin Observatory Legacy Survey of Space and Time.


title: The Near Infrared Imager and Slitless Spectrograph for the James Webb Space Telescope -- IV. Aperture Masking Interferometry

abstract: The James Webb Space Telescope's Near Infrared Imager and Slitless Spectrograph (JWST-NIRISS) flies a 7-hole non-redundant mask (NRM), the first such interferometer in space, operating at 3-5 \micron~wavelengths, and a bright limit of $\simeq 4$ magnitudes in W2. We describe the NIRISS Aperture Masking Interferometry (AMI) mode to help potential observers understand its underlying principles, present some sample science cases, explain its operational observing strategies, indicate how AMI proposals can be developed with data simulations, and how AMI data can be analyzed. We also present key results from commissioning AMI. Since the allied Kernel Phase Imaging (KPI) technique benefits from AMI operational strategies, we also cover NIRISS KPI methods and analysis techniques, including a new user-friendly KPI pipeline. The NIRISS KPI bright limit is $\simeq 8$ W2 magnitudes. AMI (and KPI) achieve an inner working angle of $\sim 70$ mas that is well inside the $\sim 400$ mas NIRCam inner working angle for its circular occulter coronagraphs at comparable wavelengths.


title: Ensemble transport smoothing. Part II: Nonlinear updates

abstract: Smoothing is a specialized form of Bayesian inference for state-space models that characterizes the posterior distribution of a collection of states given an associated sequence of observations. Ramgraber et al. (2023) proposes a general framework for transport-based ensemble smoothing, which includes linear Kalman-type smoothers as special cases. Here, we build on this foundation to realize and demonstrate nonlinear backward ensemble transport smoothers. We discuss parameterization and regularization of the associated transport maps, and then examine the performance of these smoothers for nonlinear and chaotic dynamical systems that exhibit non-Gaussian behavior. In these settings, our nonlinear transport smoothers yield lower estimation error than conventional linear smoothers and state-of-the-art iterative ensemble Kalman smoothers, for comparable numbers of model evaluations.


title: A sharp square function estimate for the moment curve in $\mathbb{R}^3$

abstract: We prove a sharp (up to $C_\epsilon R^\epsilon$) $L^7$ square function estimate for the moment curve in $\mathbb{R}^3$.


title: Learning New Tasks from a Few Examples with Soft-Label Prototypes

abstract: Existing approaches to few-shot learning in NLP rely on large language models and fine-tuning of these to generalise on out-of-distribution data. In this work, we propose a simple yet powerful approach to "extreme" few-shot learning, wherein models are exposed to as little as 4 examples per class, based on soft-label prototypes that collectively capture the distribution of different classes across the input domain space. Inspired by previous work (Sucholutsky et al., 2021) on univariate or simple multivariate (synthetic) data, we propose a novel approach that is effective on large, high-dimensional and real-world datasets. We learn soft-label prototypes within a neural framework (DeepSLP) and we experimentally demonstrate that it achieves superior performance on 31/48 tested tasks and few-shot settings while closely matching the performance of strong baselines on the rest. We focus on learning previously unseen NLP tasks from very few examples (4, 8, 16) per label and present an in-depth analysis of the effectiveness of our approach.


title: Photo-accelerated water dissociation across one-atom-thick electrodes

abstract: Recent experiments demonstrated that interfacial water dissociation (H2O = H+ + OH-) could be accelerated exponentially by an electric field applied to graphene electrodes, a phenomenon related to the Wien effect. Here we report an order-of-magnitude acceleration of the interfacial water dissociation reaction under visible-light illumination. This process is accompanied by spatial separation of protons and hydroxide ions across one-atom-thick graphene and enhanced by strong interfacial electric fields. The found photo-effect is attributed to the combination of graphene's perfect selectivity with respect to protons, which prevents proton-hydroxide recombination, and to proton transport acceleration by the Wien effect, which occurs in synchrony with the water dissociation reaction. Our findings provide fundamental insights into ion dynamics near atomically-thin proton-selective interfaces and suggest that strong interfacial fields can enhance and tune very fast ionic processes, which is of relevance for applications in photo-catalysis and designing reconfigurable materials.


title: Testing for practically significant dependencies in high dimensions via bootstrapping maxima of U-statistics

abstract: This paper takes a different look on the problem of testing the mutual independence of the components of a high-dimensional vector. Instead of testing if all pairwise associations (e.g. all pairwise Kendall's $\tau$) between the components vanish, we are interested in the (null)-hypothesis that all pairwise associations do not exceed a certain threshold in absolute value. The consideration of these hypotheses is motivated by the observation that in the high-dimensional regime, it is rare, and perhaps impossible, to have a null hypothesis that can be exactly modeled by assuming that all pairwise associations are precisely equal to zero. The formulation of the null hypothesis as a composite hypothesis makes the problem of constructing tests non-standard and in this paper we provide a solution for a broad class of dependence measures, which can be estimated by $U$-statistics. In particular we develop an asymptotic and a bootstrap level $\alpha$-test for the new hypotheses in the high-dimensional regime. We also prove that the new tests are minimax-optimal and investigate their finite sample properties by means of a small simulation study and a data example.


title: Semantic Novelty Detection and Characterization in Factual Text Involving Named Entities

abstract: Much of the existing work on text novelty detection has been studied at the topic level, i.e., identifying whether the topic of a document or a sentence is novel or not. Little work has been done at the fine-grained semantic level (or contextual level). For example, given that we know Elon Musk is the CEO of a technology company, the sentence "Elon Musk acted in the sitcom The Big Bang Theory" is novel and surprising because normally a CEO would not be an actor. Existing topic-based novelty detection methods work poorly on this problem because they do not perform semantic reasoning involving relations between named entities in the text and their background knowledge. This paper proposes an effective model (called PAT-SND) to solve the problem, which can also characterize the novelty. An annotated dataset is also created. Evaluation shows that PAT-SND outperforms 10 baselines by large margins.


title: Numerical stochastic inflation constrained by frozen noise

abstract: Stochastic inflation can resolve strong inflationary perturbations, which seed primordial black holes. I present a fast and accurate way to compute these perturbations in typical black hole producing single-field models, treating the short-wavelength Fourier modes beyond the de Sitter approximation. The squeezing and freezing of the modes reduces the problem to one dimension, and the resulting new form of the stochastic equations, dubbed `constrained stochastic inflation,' can be solved efficiently with semi-analytical techniques and numerical importance sampling. In an example case, the perturbation distribution is resolved in seconds deep into its non-Gaussian tail, a speed-up of factor $10^9$ compared to a previous study. Along the way, I comment on the role of the momentum constraint in stochastic inflation.


title: A Faster Approach to Spiking Deep Convolutional Neural Networks

abstract: Spiking neural networks (SNNs) have closer dynamics to the brain than current deep neural networks. Their low power consumption and sample efficiency make these networks interesting. Recently, several deep convolutional spiking neural networks have been proposed. These networks aim to increase biological plausibility while creating powerful tools to be applied to machine learning tasks. Here, we suggest a network structure based on previous work to improve network runtime and accuracy. Improvements to the network include reducing training iterations to only once, effectively using principal component analysis (PCA) dimension reduction, weight quantization, timed outputs for classification, and better hyperparameter tuning. Furthermore, the preprocessing step is changed to allow the processing of colored images instead of only black and white to improve accuracy. The proposed structure fractionalizes runtime and introduces an efficient approach to deep convolutional SNNs.


title: Learning macroscopic internal variables and history dependence from microscopic models

abstract: This paper concerns the study of history dependent phenomena in heterogeneous materials in a two-scale setting where the material is specified at a fine microscopic scale of heterogeneities that is much smaller than the coarse macroscopic scale of application. We specifically study a polycrystalline medium where each grain is governed by crystal plasticity while the solid is subjected to macroscopic dynamic loads. The theory of homogenization allows us to solve the macroscale problem directly with a constitutive relation that is defined implicitly by the solution of the microscale problem. However, the homogenization leads to a highly complex history dependence at the macroscale, one that can be quite different from that at the microscale. In this paper, we examine the use of machine-learning, and especially deep neural networks, to harness data generated by repeatedly solving the finer scale model to: (i) gain insights into the history dependence and the macroscopic internal variables that govern the overall response; and (ii) to create a computationally efficient surrogate of its solution operator, that can directly be used at the coarser scale with no further modeling. We do so by introducing a recurrent neural operator (RNO), and show that: (i) the architecture and the learned internal variables can provide insight into the physics of the macroscopic problem; and (ii) that the RNO can provide multiscale, specifically FE2, accuracy at a cost comparable to a conventional empirical constitutive relation.


title: Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representations

abstract: Learning effective joint embedding for cross-modal data has always been a focus in the field of multimodal machine learning. We argue that during multimodal fusion, the generated multimodal embedding may be redundant, and the discriminative unimodal information may be ignored, which often interferes with accurate prediction and leads to a higher risk of overfitting. Moreover, unimodal representations also contain noisy information that negatively influences the learning of cross-modal dynamics. To this end, we introduce the multimodal information bottleneck (MIB), aiming to learn a powerful and sufficient multimodal representation that is free of redundancy and to filter out noisy information in unimodal representations. Specifically, inheriting from the general information bottleneck (IB), MIB aims to learn the minimal sufficient representation for a given task by maximizing the mutual information between the representation and the target and simultaneously constraining the mutual information between the representation and the input data. Different from general IB, our MIB regularizes both the multimodal and unimodal representations, which is a comprehensive and flexible framework that is compatible with any fusion methods. We develop three MIB variants, namely, early-fusion MIB, late-fusion MIB, and complete MIB, to focus on different perspectives of information constraints. Experimental results suggest that the proposed method reaches state-of-the-art performance on the tasks of multimodal sentiment analysis and multimodal emotion recognition across three widely used datasets. The codes are available at \url{https://github.com/TmacMai/Multimodal-Information-Bottleneck}.


title: On the wave turbulence theory for a stochastic KdV type equation -- Generalization for the inhomogeneous kinetic limit

abstract: Starting from a stochastic Zakharov-Kuznetsov (ZK) equation on a lattice, the previous work [ST21] by the last two authors gave a derivation of the homogeneous 3-wave kinetic equation at the kinetic limit under very general assumptions: the initial condition is out of equilibrium, the dimension $d\ge 2$, the smallness of the nonlinearity $\lambda$ is allowed to be independent of the size of the lattice, the weak noise is chosen not to compete with the weak nonlinearity and not to inject energy into the equation. In the present work, we build on the framework of [ST21], following the formal derivation of Spohn [Spo06] and inspired by previous work [HO21] of the first author and Olla, so that the inhomogeneous 3-wave kinetic equation can also be obtained at the kinetic limit under analogous assumptions. Similar to the homogeneous case -- and unlike the cubic nonlinear Schr\"odinger equation -- the inhomogeneous kinetic description of the deterministic lattice ZK equation is unlikely to happen due to the vanishing of the dispersion relation on a certain singular manifold on which not only $3$-wave interactions but also all $n$-wave interactions ($n\ge3$) are allowed to happen, a phenomenon first observed by Lukkarinen [Luk07]. To the best of our knowledge, our work provides the first rigorous derivation of a nonlinear inhomogeneous wave kinetic equation in the kinetic limit.


title: Long-lived heavy neutral leptons with a displaced shower signature at CMS

abstract: We study the LHC discovery potential in the search for heavy neutral leptons (HNL) with a new signature: a displaced shower in the CMS muon detector, giving rise to a large cluster of hits forming a displaced shower. A new Delphes module is used to model the CMS detector response for such displaced decays. We reinterpret a dedicated CMS search for neutral long-lived particles decaying in the CMS muon endcap detectors for the minimal HNL scenario. We demonstrate that this new strategy is particularly sensitive to active-sterile mixings with $\tau$ leptons, due to hadronic $\tau$ decays. HNL masses between $\sim 1 - 6$ GeV can be accessed for mixings as low as $|V_{\tau N}|^{2}\sim 10^{-7}$, probing unique regions of parameter space in the $\tau$ sector.


title: Invariants of $2$-knots

abstract: This short survey, which was written to accompany a minicourse at the BIRS conference "Topology in dimension 4.5", concerns invariants of knotted $2$-spheres in $S^4$, also known as $2$-knots. It covers invariants extracted from the algebraic topology of the knot exterior, including Alexander invariants, the Farber-Levine pairing and Casson-Gordon invariants, as well as gauge theoretic and combinatorial invariants. Details are scarce and new results inexistant.


title: Geometry of phase-covariant qubit channels

abstract: We analyze the geometry on the space of non-unital phase-covariant qubit maps. Using the corresponding Choi-Jamio{\l}kowski states, we derive the Hilbert-Schmidt line and volume elements using the channel eigenvalues together with the parameter that characterizes non-unitality. We find the shapes and analytically compute the volumes of phase-covariant channels, in particular entanglement breaking and obtainable with time-local generators.


title: Globally Gated Deep Linear Networks

abstract: Recently proposed Gated Linear Networks present a tractable nonlinear network architecture, and exhibit interesting capabilities such as learning with local error signals and reduced forgetting in sequential learning. In this work, we introduce a novel gating architecture, named Globally Gated Deep Linear Networks (GGDLNs) where gating units are shared among all processing units in each layer, thereby decoupling the architectures of the nonlinear but unlearned gatings and the learned linear processing motifs. We derive exact equations for the generalization properties in these networks in the finite-width thermodynamic limit, defined by $P,N\rightarrow\infty, P/N\sim O(1)$, where P and N are the training sample size and the network width respectively. We find that the statistics of the network predictor can be expressed in terms of kernels that undergo shape renormalization through a data-dependent matrix compared to the GP kernels. Our theory accurately captures the behavior of finite width GGDLNs trained with gradient descent dynamics. We show that kernel shape renormalization gives rise to rich generalization properties w.r.t. network width, depth and L2 regularization amplitude. Interestingly, networks with sufficient gating units behave similarly to standard ReLU networks. Although gatings in the model do not participate in supervised learning, we show the utility of unsupervised learning of the gating parameters. Additionally, our theory allows the evaluation of the network's ability for learning multiple tasks by incorporating task-relevant information into the gating units. In summary, our work is the first exact theoretical solution of learning in a family of nonlinear networks with finite width. The rich and diverse behavior of the GGDLNs suggests that they are helpful analytically tractable models of learning single and multiple tasks, in finite-width nonlinear deep networks.