title: Artificial Life using a Book and Bookmarker

abstract: Reproduction, development, and individual interactions are essential topics in artificial life. The cellular automata, which can handle these in a composite way, is highly restricted in its form and behavior because it represents life as a pattern of cells. In contrast, the virtual creatures proposed by Karl Sims have a very high degree of freedom in terms of morphology and behavior. However, they have limited expressive capacity in terms of those viewpoints. This study carefully extracts the characteristics of the cellular automata and Sims models to propose a new artificial life model that can simulate reproduction, development, and individual interactions while exhibiting high expressive power for morphology and behavior. The simulation was performed by sequentially reading a book with genetic information and repeatedly executing four actions: expansion, connection, disconnection, and transition. The virtual creatures in the proposed model exhibit unique survival strategies and lifestyles and acquire interesting properties in reproduction, development, and individual interactions while having freedom in morphology and behavior.


title: GRB 221009A: a potential source of ultra-high-energy cosmic rays

abstract: Recently an extraordinarily bright gamma-ray burst, GRB 221009A, was observed by several facilities covering the whole electromagnetic spectrum. Gamma rays with energies up to 18 TeV were detected, as well as a possible photon with 251 TeV. Such energetic events are not expected because they would be attenuated by pair-production interactions with the extragalactic background light. This tension is, however, only apparent, and does not call for any unconventional explanation. Here I show that these observations can be interpreted as the result of ultra-high-energy cosmic rays (UHECRs) interacting with cosmological radiation fields during their journey to Earth, provided that intergalactic magnetic fields are reasonably weak. If this hypothesis is correct, it would establish bursts like GRB 221009A as UHECR sources.


title: Symmetry and Variance: Generative Parametric Modelling of Historical Brick Wall Patterns

abstract: This study integrates artificial intelligence and computational design tools to extract information from architectural heritage. Photogrammetry-based point cloud models of brick walls from the Anatolian Seljuk period are analysed in terms of the interrelated units of construction, simultaneously considering both the inherent symmetries and irregularities. The real-world data is used as input for acquiring the stochastic parameters of spatial relations and a set of parametric shape rules to recreate designs of existing and hypothetical brick walls within the style. The motivation is to be able to generate large data sets for machine learning of the style and to devise procedures for robotic production of such designs with repetitive units.


title: Bootstrapping meaning through listening: Unsupervised learning of spoken sentence embeddings

abstract: Inducing semantic representations directly from speech signals is a highly challenging task but has many useful applications in speech mining and spoken language understanding. This study tackles the unsupervised learning of semantic representations for spoken utterances. Through converting speech signals into hidden units generated from acoustic unit discovery, we propose WavEmbed, a multimodal sequential autoencoder that predicts hidden units from a dense representation of speech. Secondly, we also propose S-HuBERT to induce meaning through knowledge distillation, in which a sentence embedding model is first trained on hidden units and passes its knowledge to a speech encoder through contrastive learning. The best performing model achieves a moderate correlation (0.5~0.6) with human judgments, without relying on any labels or transcriptions. Furthermore, these models can also be easily extended to leverage textual transcriptions of speech to learn much better speech embeddings that are strongly correlated with human annotations. Our proposed methods are applicable to the development of purely data-driven systems for speech mining, indexing and search.


title: Kadabra: Adapting Kademlia for the Decentralized Web

abstract: Blockchains have become the catalyst for a growing movement to create a more decentralized Internet. A fundamental operation of applications in a decentralized Internet is data storage and retrieval. As today's blockchains are limited in their storage functionalities, in recent years a number of peer-to-peer data storage networks have emerged based on the Kademlia distributed hash table protocol. However, existing Kademlia implementations are not efficient enough to support fast data storage and retrieval operations necessary for (decentralized) Web applications. In this paper, we present Kadabra, a decentralized protocol for computing the routing table entries in Kademlia to accelerate lookups. Kadabra is motivated by the multi-armed bandit problem, and can automatically adapt to heterogeneity and dynamism in the network. Experimental results show Kadabra achieving between 15-50% lower lookup latencies compared to state-of-the-art baselines.


title: A Stack-Free Traversal Algorithm for Left-Balanced k-d Trees

abstract: We present an algorithm that allows for find-closest-point and kNN-style traversals of left-balanced k-d trees, without the need for either recursion or software-managed stacks; instead using only current and last previously traversed node to compute which node to traverse next.


title: Explicit Second-Order Min-Max Optimization Methods with Optimal Convergence Guarantee

abstract: We propose and analyze several inexact regularized Newton-type methods for finding a global saddle point of \emph{convex-concave} unconstrained min-max optimization problems. Compared to first-order methods, our understanding of second-order methods for min-max optimization is relatively limited, as obtaining global rates of convergence with second-order information is much more involved. In this paper, we examine how second-order information can be used to speed up extra-gradient methods, even under inexactness. Specifically, we show that the proposed methods generate iterates that remain within a bounded set and that the averaged iterates converge to an $\epsilon$-saddle point within $O(\epsilon^{-2/3})$ iterations in terms of a restricted gap function. This matched the theoretically established lower bound in this context. We also provide a simple routine for solving the subproblem at each iteration, requiring a single Schur decomposition and $O(\log\log(1/\epsilon))$ calls to a linear system solver in a quasi-upper-triangular system. Thus, our method improves the existing line-search-based second-order min-max optimization methods by shaving off an $O(\log\log(1/\epsilon))$ factor in the required number of Schur decompositions. Finally, we present numerical experiments on synthetic and real data that demonstrate the efficiency of the proposed methods.


title: Tight relative estimation in the mean of Bernoulli random variables

abstract: Given a stream of Bernoulli random variables, consider the problem of estimating the mean of the random variable within a specified relative error with a specified probability of failure. Until now, the Gamma Bernoulli Approximation Scheme (GBAS) was the method that accomplished this goal using the smallest number of average samples. In this work, a new method is introduced that is faster when the mean is bounded away from zero. The process uses a two-stage process together with some simple inequalities to get rigorous bounds on the error probability.


title: Optimal Discriminant Analysis in High-Dimensional Latent Factor Models

abstract: In high-dimensional classification problems, a commonly used approach is to first project the high-dimensional features into a lower dimensional space, and base the classification on the resulting lower dimensional projections. In this paper, we formulate a latent-variable model with a hidden low-dimensional structure to justify this two-step procedure and to guide which projection to choose. We propose a computationally efficient classifier that takes certain principal components (PCs) of the observed features as projections, with the number of retained PCs selected in a data-driven way. A general theory is established for analyzing such two-step classifiers based on any projections. We derive explicit rates of convergence of the excess risk of the proposed PC-based classifier. The obtained rates are further shown to be optimal up to logarithmic factors in the minimax sense. Our theory allows the lower-dimension to grow with the sample size and is also valid even when the feature dimension (greatly) exceeds the sample size. Extensive simulations corroborate our theoretical findings. The proposed method also performs favorably relative to other existing discriminant methods on three real data examples.


title: Overview of Dialogue Robot Competition 2022

abstract: Although many competitions have been held on dialogue systems in the past, no competition has been organized specifically for dialogue with humanoid robots. As the first such attempt in the world, we held a dialogue robot competition in 2020 to compare the performances of interactive robots using an android that closely resembles a human. Dialogue Robot Competition 2022 (DRC2022) was the second competition, held in August 2022. The task and regulations followed those of the first competition, while the evaluation method was improved and the event was internationalized. The competition has two rounds, a preliminary round and the final round. In the preliminary round, twelve participating teams competed in performance of a dialogue robot in the manner of a field experiment, and then three of those teams were selected as finalists. The final round will be held on October 25, 2022, in the Robot Competition session of IROS2022. This paper provides an overview of the task settings and evaluation method of DRC2022 and the results of the preliminary round.


title: K-SAM: Sharpness-Aware Minimization at the Speed of SGD

abstract: Sharpness-Aware Minimization (SAM) has recently emerged as a robust technique for improving the accuracy of deep neural networks. However, SAM incurs a high computational cost in practice, requiring up to twice as much computation as vanilla SGD. The computational challenge posed by SAM arises because each iteration requires both ascent and descent steps and thus double the gradient computations. To address this challenge, we propose to compute gradients in both stages of SAM on only the top-k samples with highest loss. K-SAM is simple and extremely easy-to-implement while providing significant generalization boosts over vanilla SGD at little to no additional cost.


title: Knowledge Transfer from Answer Ranking to Answer Generation

abstract: Recent studies show that Question Answering (QA) based on Answer Sentence Selection (AS2) can be improved by generating an improved answer from the top-k ranked answer sentences (termed GenQA). This allows for synthesizing the information from multiple candidates into a concise, natural-sounding answer. However, creating large-scale supervised training data for GenQA models is very challenging. In this paper, we propose to train a GenQA model by transferring knowledge from a trained AS2 model, to overcome the aforementioned issue. First, we use an AS2 model to produce a ranking over answer candidates for a set of questions. Then, we use the top ranked candidate as the generation target, and the next k top ranked candidates as context for training a GenQA model. We also propose to use the AS2 model prediction scores for loss weighting and score-conditioned input/output shaping, to aid the knowledge transfer. Our evaluation on three public and one large industrial datasets demonstrates the superiority of our approach over the AS2 baseline, and GenQA trained using supervised data.


title: Mechanical properties of AlMgB14-related boron carbide structures. A first principle study

abstract: We examine the effects produced by replacing B-B interlayer bonds by C-C bonds in AlMgB14-related boron network on its mechanical properties. The elastic constants, Vickers hardness and shear strength are evaluated by means of first principle computer simulations on the basis of density functional theory. The results of simulations suggest a possibility of existence of several orthorhombic boron carbide phases with strongly enhanced mechanical properties with the Young modulus and Vickers hardness being within the range of 550-600 GPa and 43-50 GPa, respectively


title: Deep Equilibrium Approaches to Diffusion Models

abstract: Diffusion-based generative models are extremely effective in generating high-quality images, with generated samples often surpassing the quality of those produced by other models under several metrics. One distinguishing feature of these models, however, is that they typically require long sampling chains to produce high-fidelity images. This presents a challenge not only from the lenses of sampling time, but also from the inherent difficulty in backpropagating through these chains in order to accomplish tasks such as model inversion, i.e. approximately finding latent states that generate known images. In this paper, we look at diffusion models through a different perspective, that of a (deep) equilibrium (DEQ) fixed point model. Specifically, we extend the recent denoising diffusion implicit model (DDIM; Song et al. 2020), and model the entire sampling chain as a joint, multivariate fixed point system. This setup provides an elegant unification of diffusion and equilibrium models, and shows benefits in 1) single image sampling, as it replaces the fully-serial typical sampling process with a parallel one; and 2) model inversion, where we can leverage fast gradients in the DEQ setting to much more quickly find the noise that generates a given image. The approach is also orthogonal and thus complementary to other methods used to reduce the sampling time, or improve model inversion. We demonstrate our method's strong performance across several datasets, including CIFAR10, CelebA, and LSUN Bedrooms and Churches.


title: Computing the Matching Distance of 2-Parameter Persistence Modules from Critical Values

abstract: The exact computation of the matching distance for multi-parameter persistence modules is an active area of research in computational topology. Achieving an easily obtainable exact computation of this distance would allow multi-parameter persistent homology to be a viable option for data analysis. In this paper, we provide theoretical results for the computation of the matching distance in two dimensions along with a geometric interpretation of the lines through parameter space realizing this distance. The crucial point of the method we propose is that it can be easily implemented.


title: Robust Multi-Hypothesis Testing with Moment Constrained Uncertainty Sets

abstract: The problem of robust binary hypothesis testing is studied. Under both hypotheses, the data-generating distributions are assumed to belong to uncertainty sets constructed through moments; in particular, the sets contain distributions whose moments are centered around the empirical moments obtained from training samples. The goal is to design a test that performs well under all distributions in the uncertainty sets, i.e., minimize the worst-case error probability over the uncertainty sets. In the finite-alphabet case, the optimal test is obtained. In the infinite-alphabet case, a tractable approximation to the worst-case error is derived that converges to the optimal value using finite samples from the alphabet. A test is further constructed to generalize to the entire alphabet. An exponentially consistent test for testing batch samples is also proposed. Numerical results are provided to demonstrate the performance of the proposed robust tests.


title: Imbalanced Class Data Performance Evaluation and Improvement using Novel Generative Adversarial Network-based Approach: SSG and GBO

abstract: Class imbalance in a dataset is one of the major challenges that can significantly impact the performance of machine learning models resulting in biased predictions. Numerous techniques have been proposed to address class imbalanced problems, including, but not limited to, Oversampling, Undersampling, and cost-sensitive approaches. Due to its ability to generate synthetic data, oversampling techniques such as the Synthetic Minority Oversampling Technique (SMOTE) is among the most widely used methodology by researchers. However, one of SMOTE's potential disadvantages is that newly created minor samples may overlap with major samples. As an effect, the probability of ML models' biased performance towards major classes increases. Recently, generative adversarial network (GAN) has garnered much attention due to its ability to create almost real samples. However, GAN is hard to train even though it has much potential. This study proposes two novel techniques: GAN-based Oversampling (GBO) and Support Vector Machine-SMOTE-GAN (SSG) to overcome the limitations of the existing oversampling approaches. The preliminary computational result shows that SSG and GBO performed better on the expanded imbalanced eight benchmark datasets than the original SMOTE. The study also revealed that the minor sample generated by SSG demonstrates Gaussian distributions, which is often difficult to achieve using original SMOTE.


title: Tighter Abstract Queries in Neural Network Verification

abstract: Neural networks have become critical components of reactive systems in various domains within computer science. Despite their excellent performance, using neural networks entails numerous risks that stem from our lack of ability to understand and reason about their behavior. Due to these risks, various formal methods have been proposed for verifying neural networks; but unfortunately, these typically struggle with scalability barriers. Recent attempts have demonstrated that abstraction-refinement approaches could play a significant role in mitigating these limitations; but these approaches can often produce networks that are so abstract, that they become unsuitable for verification. To deal with this issue, we present CEGARETTE, a novel verification mechanism where both the system and the property are abstracted and refined simultaneously. We observe that this approach allows us to produce abstract networks which are both small and sufficiently accurate, allowing for quick verification times while avoiding a large number of refinement steps. For evaluation purposes, we implemented CEGARETTE as an extension to the recently proposed CEGAR-NN framework. Our results are very promising, and demonstrate a significant improvement in performance over multiple benchmarks.


title: Socio-cognitive Optimization of Time-delay Control Problems using Evolutionary Metaheuristics

abstract: Metaheuristics are universal optimization algorithms which should be used for solving difficult problems, unsolvable by classic approaches. In this paper we aim at constructing novel socio-cognitive metaheuristic based on castes, and apply several versions of this algorithm to optimization of time-delay system model. Besides giving the background and the details of the proposed algorithms we apply them to optimization of selected variants of the problem and discuss the results.


title: FLIP: A Provable Defense Framework for Backdoor Mitigation in Federated Learning

abstract: Federated Learning (FL) is a distributed learning paradigm that enables different parties to train a model together for high quality and strong privacy protection. In this scenario, individual participants may get compromised and perform backdoor attacks by poisoning the data (or gradients). Existing work on robust aggregation and certified FL robustness does not study how hardening benign clients can affect the global model (and the malicious clients). In this work, we theoretically analyze the connection among cross-entropy loss, attack success rate, and clean accuracy in this setting. Moreover, we propose a trigger reverse engineering based defense and show that our method can achieve robustness improvement with guarantee (i.e., reducing the attack success rate) without affecting benign accuracy. We conduct comprehensive experiments across different datasets and attack settings. Our results on eight competing SOTA defense methods show the empirical superiority of our method on both single-shot and continuous FL backdoor attacks. Code is available at https://github.com/KaiyuanZh/FLIP.


title: Global Contrastive Batch Sampling via Optimization on Sample Permutations

abstract: Contrastive Learning has recently achieved state-of-the-art performance in a wide range of tasks. Many contrastive learning approaches use mined hard negatives to make batches more informative during training but these approaches are inefficient as they increase epoch length proportional to the number of mined negatives and require frequent updates of nearest neighbor indices or mining from recent batches. In this work, we provide an alternative to hard negative mining, Global Contrastive Batch Sampling (GCBS), an efficient approximation to the batch assignment problem that upper bounds the gap between the global and training losses, $\mathcal{L}^{Global} - \mathcal{L}^{Train}$, in contrastive learning settings. Through experimentation we find GCBS improves state-of-the-art performance in sentence embedding and code-search tasks. Additionally, GCBS is easy to implement as it requires only a few additional lines of code, does not maintain external data structures such as nearest neighbor indices, is more computationally efficient than the most minimal hard negative mining approaches, and makes no changes to the model being trained.


title: Fermi Gamma-ray Space Telescope

abstract: The Fermi Gamma-ray Space Telescope, a key mission in multiwavelength and multimessenger studies, has been surveying the gamma-ray sky from its low-Earth orbit since 2008. Its two scientific instruments, the Gamma-ray Burst Monitor (GBM) and the Large Area Telescope (LAT), cover 8 orders of magnitude in photon energy. The GBM consists of 12 Sodium Iodide detectors and 2 Bismuth Germinate detectors, covering the 10 keV - 40 MeV energy range, arrayed on two sides of the spacecraft so as to view the entire sky that is not occulted by the Earth. The LAT is a pair production telescope based on silicon strip trackers, a Cesium Iodide calorimeter, and a plastic scintillator anticoincidence system. It covers the energy range from about 20 MeV to more than 500 GeV, with a field of view of about 2.4 steradians. Thanks to their huge fields of view, the instruments can observe the entire sky with a cadence of about an hour for GBM and about three hours for LAT. All gamma-ray data from Fermi become public immediately, enabling a broad range of multiwavelength and multimessenger research. Over 3000 gamma-ray bursts (GRBs), including GRB 170817A associated with a neutron star merger detected in gravitational waves, and 5000 high-energy sources, including the blazar TXS 0506+056 associated with high-energy neutrinos, have been detected by the Fermi instruments. The Fermi Science Support Center provides a wide array of resources to enable scientific use of the data, including background models, source catalogs, analysis software, documentation, and a Help Desk.


title: Analysis of Ayscough's Telescope Adapted to Use at Sea

abstract: An unambiguous accordance between an objective lens for Ayscough's telescope 'Adapted to Use at Sea' and another compound lens which was described by William Eastland in well-known Quere during the trial in October of 1765 was revealed. Preliminary analysis of small fragments of Quere from Eastland', Stedman' and Champneys' testimonies was carried.


title: A Secure Design Pattern Approach Toward Tackling Lateral-Injection Attacks

abstract: Software weaknesses that create attack surfaces for adversarial exploits, such as lateral SQL injection (LSQLi) attacks, are usually introduced during the design phase of software development. Security design patterns are sometimes applied to tackle these weaknesses. However, due to the stealthy nature of lateral-based attacks, employing traditional security patterns to address these threats is insufficient. Hence, we present SEAL, a secure design that extrapolates architectural, design, and implementation abstraction levels to delegate security strategies toward tackling LSQLi attacks. We evaluated SEAL using case study software, where we assumed the role of an adversary and injected several attack vectors tasked with compromising the confidentiality and integrity of its database. Our evaluation of SEAL demonstrated its capacity to address LSQLi attacks.


title: IDD-3D: Indian Driving Dataset for 3D Unstructured Road Scenes

abstract: Autonomous driving and assistance systems rely on annotated data from traffic and road scenarios to model and learn the various object relations in complex real-world scenarios. Preparation and training of deploy-able deep learning architectures require the models to be suited to different traffic scenarios and adapt to different situations. Currently, existing datasets, while large-scale, lack such diversities and are geographically biased towards mainly developed cities. An unstructured and complex driving layout found in several developing countries such as India poses a challenge to these models due to the sheer degree of variations in the object types, densities, and locations. To facilitate better research toward accommodating such scenarios, we build a new dataset, IDD-3D, which consists of multi-modal data from multiple cameras and LiDAR sensors with 12k annotated driving LiDAR frames across various traffic scenarios. We discuss the need for this dataset through statistical comparisons with existing datasets and highlight benchmarks on standard 3D object detection and tracking tasks in complex layouts. Code and data available at https://github.com/shubham1810/idd3d_kit.git


title: Control and Entanglement of Individual Rydberg Atoms Near a Nanoscale Device

abstract: Rydberg atom arrays constitute a promising quantum information platform, where control over several hundred qubits has been demonstrated. Further scaling could significantly benefit from coupling to integrated optical or electronic devices, enabling quantum networking and new control tools, but this integration is challenging due to Rydberg sensitivity to the electric field noise from surfaces. We demonstrate that Rydberg coherence and two-atom entanglement can be generated and maintained at distances of 100 microns from a nanoscale dielectric device. Using coherent manipulation of individual qubits and entanglement-assisted sensing, we map the spatio-temporal properties of the electric field environment, enabling its control and the integration of Rydberg arrays with micro- and nanoscale devices.


title: Tidally excited gravity waves in the cores of solar-type stars: resonances and critical-layer formation

abstract: We simulate the propagation and dissipation of tidally induced nonlinear gravity waves in the cores of solar-type stars. We perform hydrodynamical simulations of a previously developed Boussinesq model using a spectral-element code to study the stellar core as a wave cavity that is periodically forced at the outer boundary with a given azimuthal wavenumber and an adjustable frequency. For low-amplitude forcing, the system exhibits resonances with standing g-modes at particular frequencies, corresponding to a situation in which the tidal torque is highly frequency-dependent. For high-amplitude forcing, the excited waves break promptly near the centre and spin up the core so that subsequent waves are absorbed in an expanding critical layer, as found in previous work, leading to a tidal torque with a smooth frequency-dependence. For intermediate-amplitude forcing, we find that linear damping of the waves gradually spins up the core such that the resonance condition can be altered drastically. The system can evolve towards or away from g-mode resonances, depending on the difference between the forcing frequency and the closest eigenfrequency. Eventually, a critical layer forms and absorbs the incoming waves, leading to a situation similar to the high-amplitude case in which the waves break promptly. We study the dependence of this process on the forcing amplitude and frequency, as well as on the diffusion coefficients. We emphasize that the small Prandtl number in the centre of solar-like stars facilitates the development of a differentially rotating core owing to the nonlinear feedback of waves. Our simulations and analysis reveal that this important mechanism may drastically change the phase of gravity waves and thus the classical picture of resonance locking in solar-type stars needs to be revised.


title: A Control Theoretic Approach to Infrastructure-Centric Blockchain Tokenomics

abstract: There are a multitude of Blockchain-based physical infrastructure systems, operating on a crypto-currency enabled token economy, where infrastructure suppliers are rewarded with tokens for enabling, validating, managing and/or securing the system. However, today's token economies are largely designed without infrastructure systems in mind, and often operate with a fixed token supply (e.g., Bitcoin). This paper argues that token economies for infrastructure networks should be structured differently - they should continually incentivize new suppliers to join the network to provide services and support to the ecosystem. As such, the associated token rewards should gracefully scale with the size of the decentralized system, but should be carefully balanced with consumer demand to manage inflation and be designed to ultimately reach an equilibrium. To achieve such an equilibrium, the decentralized token economy should be adaptable and controllable so that it maximizes the total utility of all users, such as achieving stable (overall non-inflationary) token economies. Our main contribution is to model infrastructure token economies as dynamical systems - the circulating token supply, price, and consumer demand change as a function of the payment to nodes and costs to consumers for infrastructure services. Crucially, this dynamical systems view enables us to leverage tools from mathematical control theory to optimize the overall decentralized network's performance. Moreover, our model extends easily to a Stackelberg game between the controller and the nodes, which we use for robust, strategic pricing. In short, we develop predictive, optimization-based controllers that outperform traditional algorithmic stablecoin heuristics by up to $2.4 \times$ in simulations based on real demand data from existing decentralized wireless networks.

categories: cs.DC cs.CR cs.CY cs.SY econ.GN eess.SY q-fin.EC


title: Stochastic Mirror Descent for Large-Scale Sparse Recovery

abstract: In this paper we discuss an application of Stochastic Approximation to statistical estimation of high-dimensional sparse parameters. The proposed solution reduces to resolving a penalized stochastic optimization problem on each stage of a multistage algorithm; each problem being solved to a prescribed accuracy by the non-Euclidean Composite Stochastic Mirror Descent (CSMD) algorithm. Assuming that the problem objective is smooth and quadratically minorated and stochastic perturbations are sub-Gaussian, our analysis prescribes the method parameters which ensure fast convergence of the estimation error (the radius of a confidence ball of a given norm around the approximate solution). This convergence is linear during the first "preliminary" phase of the routine and is sublinear during the second "asymptotic" phase. We consider an application of the proposed approach to sparse Generalized Linear Regression problem. In this setting, we show that the proposed algorithm attains the optimal convergence of the estimation error under weak assumptions on the regressor distribution. We also present a numerical study illustrating the performance of the algorithm on high-dimensional simulation data.


title: A Greek Parliament Proceedings Dataset for Computational Linguistics and Political Analysis

abstract: Large, diachronic datasets of political discourse are hard to come across, especially for resource-lean languages such as Greek. In this paper, we introduce a curated dataset of the Greek Parliament Proceedings that extends chronologically from 1989 up to 2020. It consists of more than 1 million speeches with extensive metadata, extracted from 5,355 parliamentary record files. We explain how it was constructed and the challenges that we had to overcome. The dataset can be used for both computational linguistics and political analysis-ideally, combining the two. We present such an application, showing (i) how the dataset can be used to study the change of word usage through time, (ii) between significant historical events and political parties, (iii) by evaluating and employing algorithms for detecting semantic shifts.


title: Computing the minimum distance of the $C(\mathbb{O}_{3,6})$ polar Orthogonal Grassmann code with elementary methods

abstract: The polar orthogonal Grassmann code $C(\mathbb{O}_{3,6})$ is the linear code associated to the Grassmann embedding of the Dual Polar space of $Q^+(5,q)$. In this manuscript we study the minimum distance of this embedding. We prove that the minimum distance of the polar orthogonal Grassmann code $C(\mathbb{O}_{3,6})$ is $q^3-q^3$ for $q$ odd and $q^3$ for $q$ even. Our technique is based on partitioning the orthogonal space into different sets such that on each partition the code $C(\mathbb{O}_{3,6})$ is identified with evaluations of determinants of skew--symmetric matrices. Our bounds come from elementary algebraic methods counting the zeroes of particular classes of polynomials. We expect our techniques may be applied to other polar Grassmann codes.


title: (High frequency)-uniqueness criteria for p-growth functionals in in- and compressible elasticity

abstract: In this work our main objective is to establish various (high frequency-) uniqueness criteria. Initially, we consider $p-$Dirichlet type functionals on a suitable class of measure preserving maps $u: B\subset \mathbb{R}^2 \mapsto \mathbb{R}^2,$ $B$ being the unit disk, and subject to suitable boundary conditions. In the second part we focus on a very similar situations only exchanging the previous functionals by a suitable class of $p-$growing polyconvex functionals and allowing the maps to be arbitrary. In both cases a particular emphasis is laid on high pressure situations, where only uniqueness for a subclass, containing solely of variations with high enough Fourier-modes, can be obtained.


title: X-ray Emission from the Interstellar and Circumgalactic Medium of Elliptical Galaxies based on MACER simulations

abstract: Interstellar (ISM) and circumgalactic mediums (CGM) around galaxies are linked to several physical processes that drive galaxy evolution. For example, the X-ray emission from the CGM gas around ellipticals has been linked to the AGN feedback occurring in the host. Upcoming telescopes, such as HUBS with ~2 eV resolution, can provide us with deep insights about the hot gas properties of such galaxies thus constrain these processes. In this project, we discuss X-ray emission of the ISM and CGM of elliptical galaxies simulated using MACER code. We generate X-ray emission data from the MACER simulations with various feedback models and produce mock observations for an instrument with high spectral resolution, which is a necessary step of selecting sources for the future observations with planned mission such as HUBS. More importantly, we establish connections between the physics of AGN and stellar feedback with the emission spectra from the ISM and CGM to investigate the possibility of using observations to constrain feedback models. We fit the X-ray spectra from these simulations with standard fitting procedures and compare the retrieved physical properties with their counterparts from the simulations to understand whether the future high-resolution observations can reliably reveal the properties of the gas in the galaxies.


title: Retrieval Augmentation for Commonsense Reasoning: A Unified Approach

abstract: A common thread of retrieval-augmented methods in the existing literature focuses on retrieving encyclopedic knowledge, such as Wikipedia, which facilitates well-defined entity and relation spaces that can be modeled. However, applying such methods to commonsense reasoning tasks faces two unique challenges, i.e., the lack of a general large-scale corpus for retrieval and a corresponding effective commonsense retriever. In this paper, we systematically investigate how to leverage commonsense knowledge retrieval to improve commonsense reasoning tasks. We proposed a unified framework of retrieval-augmented commonsense reasoning (called RACo), including a newly constructed commonsense corpus with over 20 million documents and novel strategies for training a commonsense retriever. We conducted experiments on four different commonsense reasoning tasks. Extensive evaluation results showed that our proposed RACo can significantly outperform other knowledge-enhanced method counterparts, achieving new SoTA performance on the CommonGen and CREAK leaderboards.


title: Tur\'an Problems for Mixed Graphs

abstract: We investigate natural Tur\'an problems for mixed graphs, generalizations of graphs where edges can be either directed or undirected. We study a natural \textit{Tur\'an density coefficient} that measures how large a fraction of directed edges an $F$-free mixed graph can have; we establish an analogue of the Erd\H{o}s-Stone-Simonovits theorem and give a variational characterization of the Tur\'an density coefficient of any mixed graph (along with an associated extremal $F$-free family). This characterization enables us to highlight an important divergence between classical extremal numbers and the Tur\'an density coefficient. We show that Tur\'an density coefficients can be irrational, but are always algebraic; for every positive integer $k$, we construct a family of mixed graphs whose Tur\'an density coefficient has algebraic degree $k$.


title: DALL-E 2 Fails to Reliably Capture Common Syntactic Processes

abstract: Machine intelligence is increasingly being linked to claims about sentience, language processing, and an ability to comprehend and transform natural language into a range of stimuli. We systematically analyze the ability of DALL-E 2 to capture 8 grammatical phenomena pertaining to compositionality that are widely discussed in linguistics and pervasive in human language: binding principles and coreference, passives, word order, coordination, comparatives, negation, ellipsis, and structural ambiguity. Whereas young children routinely master these phenomena, learning systematic mappings between syntax and semantics, DALL-E 2 is unable to reliably infer meanings that are consistent with the syntax. These results challenge recent claims concerning the capacity of such systems to understand of human language. We make available the full set of test materials as a benchmark for future testing.


title: 3+1 formulation of light modes in nonlinear electrodynamics: Minkowski spacetime

abstract: We study the light modes in nonlinear electrodynamics of Plebanski class, such as Post-Maxwellian Lagrangian, Born-Infeld Lagrangian, ModMax Lagrangian, and Heisenberg-Euler-Schwinger QED Lagrangian. Nonlinear electrodynamics provides light, a probe photon, with not only the permittivity and permeability but also the magneto-electric effect, which result in vacuum birefringence in the studied models but multirefringence in the most general Plebanski-class Lagrangians. In the Minkowski spacetime, we advance a 3+1 formulation for polarization vectors and propagation of light, and find a factorization of the Fresnel equation into two quadratures, practically allowing to find refractive indices. The polarization vectors form a basis of reciprocal vectors in the non-degenerate case. We apply the formulation to find the refractive indices and polarization vectors for the Post-Maxwellian Lagrangian, Born-Infeld Lagrangian, ModMax Lagrangian, and HES Lagrangian in an arbitrarily strong magnetic field.


title: A Transfer Operator Approach to Relativistic Quantum Wavefunction

abstract: The original intent of the Koopman-von Neumann formalism was to put classical and quantum mechanics on the same footing by introducing an operator formalism into classical mechanics. Here we pursue their path the opposite way and examine what transfer operators can say about quantum mechanical evolution. To that end, we introduce a physically motivated scalar wavefunction formalism for a velocity field on a 4-dimensional pseudo-Riemannian manifold, and obtain an evolution equation for the associated wavefunction, a generator for an associated weighted transfer operator. The generator of the scalar evolution is of first order in space and time. The probability interpretation of the formalism leads to recovery of the Schrodinger equation in the non-relativistic limit. In the special relativity limit, we show that the scalar wavefunction of Dirac spinors satisfies the new equation. A connection with string theoretic considerations for mass is provided.


title: AACHER: Assorted Actor-Critic Deep Reinforcement Learning with Hindsight Experience Replay

abstract: Actor learning and critic learning are two components of the outstanding and mostly used Deep Deterministic Policy Gradient (DDPG) reinforcement learning method. Since actor and critic learning plays a significant role in the overall robot's learning, the performance of the DDPG approach is relatively sensitive and unstable as a result. We propose a multi-actor-critic DDPG for reliable actor-critic learning to further enhance the performance and stability of DDPG. This multi-actor-critic DDPG is then integrated with Hindsight Experience Replay (HER) to form our new deep learning framework called AACHER. AACHER uses the average value of multiple actors or critics to substitute the single actor or critic in DDPG to increase resistance in the case when one actor or critic performs poorly. Numerous independent actors and critics can also gain knowledge from the environment more broadly. We implemented our proposed AACHER on goal-based environments: AuboReach, FetchReach-v1, FetchPush-v1, FetchSlide-v1, and FetchPickAndPlace-v1. For our experiments, we used various instances of actor/critic combinations, among which A10C10 and A20C20 were the best-performing combinations. Overall results show that AACHER outperforms the traditional algorithm (DDPG+HER) in all of the actor/critic number combinations that are used for evaluation. When used on FetchPickAndPlace-v1, the performance boost for A20C20 is as high as roughly 3.8 times the success rate in DDPG+HER.


title: On Universality of the S Combinator

abstract: In combinatory logic it is known that the set of two combinators K and S are universal; in the sense that any other combinator can be expressed in terms of these two. K combinator can not be expressed only in terms of the S combinator. This will answer a question raised by Stephen Wolfram as ``Is the S combinator on its own computation universal?''


title: Coalescence and sampling distributions for Feller diffusions

abstract: Consider the diffusion process defined by the forward equation $u_t(t, x) = \tfrac{1}{2}\{x u(t, x)\}_{xx} - \alpha \{x u(t, x)\}_{x}$ for $t, x \ge 0$ and $-\infty < \alpha < \infty$, with an initial condition $u(0, x) = \delta(x - x_0)$. This equation was introduced and solved by Feller to model the growth of a population of independently reproducing individuals. We explore important coalescent processes related to Feller's solution. For any $\alpha$ and $x_0 > 0$ we calculate the distribution of the random variable $A_n(s; t)$, defined as the finite number of ancestors at a time $s$ in the past of a sample of size $n$ taken from the infinite population of a Feller diffusion at a time $t$ since since its initiation. In a subcritical diffusion we find the distribution of population and sample coalescent trees from time $t$ back, conditional on non-extinction as $t \to \infty$. In a supercritical diffusion we construct a coalescent tree which has a single founder and derive the distribution of coalescent times.


title: An inf-sup approach to semigroup wellposedness for a compressible flow - incompressible fluid interactive PDE system

abstract: This work presents qualitative and numerical results on a system of partial differential equations (PDEs) which models certain fluid-fluid interaction dynamics. This system models a compressible fluid in a domain $\Omega^+ \subset \mathbb{R}^2$, coupled to an incompressible fluid modeled by Stokes flow in domain $\Omega^- \subset \mathbb{R}^2$, with the strong coupling implemented through certain boundary conditions on the shared interface, $\Gamma$. The wellposedness of this system is established by means of constructing for it a semigroup generator representation. This representation is accomplished by eliminating one of the pressure variables via identifying it as the solution of a certain boundary value problem, while the wellposedness is established via a nonstandard usage of the Babuska-Brezzi Theorem. In later sections, we demonstrate how the earlier constructive proof of wellposedness naturally lends itself to a certain finite element method (FEM), by which to numerically approximate solutions of the given coupled PDE system. This FEM is provided with error estimates and associated rates of convergence.


title: Classifying Ambiguous Identities in Hidden-Role Stochastic Games with Multi-Agent Reinforcement Learning

abstract: Multi-agent reinforcement learning (MARL) is a prevalent learning paradigm for solving stochastic games. In most MARL studies, agents in a game are defined as teammates or enemies beforehand, and the relationships among the agents remain fixed throughout the game. However, in real-world problems, the agent relationships are commonly unknown in advance or dynamically changing. Many multi-party interactions start off by asking: who is on my team? This question arises whether it is the first day at the stock exchange or the kindergarten. Therefore, training policies for such situations in the face of imperfect information and ambiguous identities is an important problem that needs to be addressed. In this work, we develop a novel identity detection reinforcement learning (IDRL) framework that allows an agent to dynamically infer the identities of nearby agents and select an appropriate policy to accomplish the task. In the IDRL framework, a relation network is constructed to deduce the identities of other agents by observing the behaviors of the agents. A danger network is optimized to estimate the risk of false-positive identifications. Beyond that, we propose an intrinsic reward that balances the need to maximize external rewards and accurate identification. After identifying the cooperation-competition pattern among the agents, IDRL applies one of the off-the-shelf MARL methods to learn the policy. To evaluate the proposed method, we conduct experiments on Red-10 card-shedding game, and the results show that IDRL achieves superior performance over other state-of-the-art MARL methods. Impressively, the relation network has the par performance to identify the identities of agents with top human players; the danger network reasonably avoids the risk of imperfect identification. The code to reproduce all the reported results is available online at https://github.com/MR-BENjie/IDRL.


title: Stochastic resolution of identity to CC2 for large systems: ground-state properties

abstract: A stochastic resolution of identity approach (sRI) is applied to the second-order coupled cluster singles and doubles (CC2) model to calculate the ground-state energy. Utilizing a set of stochastic orbitals to optimize the expensive tensor contraction steps in CC2, we greatly reduce the overall computational cost. Compared with the RI-CC2 model, the sRI-CC2 achieves scaling reduction from O(N^5) to O(N^3), where N is a measure for the system size. When applying the sRI-CC2 to a series of hydrogen dimer chains, we demonstrate that the sRI-CC2 accurately reproduces RI-CC2 results for the correlation energies and exhibits a scaling of O(NH^2.71), with NH being the number of hydrogen atoms. Our calculations with different systems and basis sets show small changes in standard deviations, which indicates a broad applicability of our approach to various systems.


title: Periodic analogues of the Kerr solutions: a numerical study

abstract: In recent years black hole configurations with non standard topology or with non-standard asymptotic have gained considerable attention. In this article we carry out numerical investigations aimed to find periodic coaxial configurations of co-rotating 3+1 vacuum black holes, for which existence and uniqueness has not yet been theoretically proven. The aimed configurations would extend Myers/Korotkin-Nicolai's family of non-rotating (static) coaxial arrays of black holes. We find that numerical solutions with a given value for the area A and for the angular momentum J of the horizons appear to exist only when the separation between consecutive horizons is larger than a certain critical value that depends only on A and |J|. We also establish that the solutions have the same Lewis's cylindrical asymptotic as Stockum's infinite rotating cylinders. Below the mentioned critical value the rotational energy appears to be too big to sustain a global equilibrium and a singularity shows up at a finite distance from the bulk. This phenomenon is a relative of Stockum's asymptotic's collapse, manifesting when the angular momentum (per unit of axial length) reaches a critical value compared to the mass (per unit of axial length), and that results from a transition in the Lewis's class of the cylindrical exterior solution. This remarkable phenomenon seems to be unexplored in the context of coaxial arrays of black holes. Ergospheres and other global properties are also presented in detail.


title: SpikeSim: An end-to-end Compute-in-Memory Hardware Evaluation Tool for Benchmarking Spiking Neural Networks

abstract: SNNs are an active research domain towards energy efficient machine intelligence. Compared to conventional ANNs, SNNs use temporal spike data and bio-plausible neuronal activation functions such as Leaky-Integrate Fire/Integrate Fire (LIF/IF) for data processing. However, SNNs incur significant dot-product operations causing high memory and computation overhead in standard von-Neumann computing platforms. Today, In-Memory Computing (IMC) architectures have been proposed to alleviate the "memory-wall bottleneck" prevalent in von-Neumann architectures. Although recent works have proposed IMC-based SNN hardware accelerators, the following have been overlooked- 1) the adverse effects of crossbar non-ideality on SNN performance due to repeated analog dot-product operations over multiple time-steps, 2) hardware overheads of essential SNN-specific components such as the LIF/IF and data communication modules. To this end, we propose SpikeSim, a tool that can perform realistic performance, energy, latency and area evaluation of IMC-mapped SNNs. SpikeSim consists of a practical monolithic IMC architecture called SpikeFlow for mapping SNNs. Additionally, the non-ideality computation engine (NICE) and energy-latency-area (ELA) engine performs hardware-realistic evaluation of SpikeFlow-mapped SNNs. Based on 65nm CMOS implementation and experiments on CIFAR10, CIFAR100 and TinyImagenet datasets, we find that the LIF/IF neuronal module has significant area contribution (>11% of the total hardware area). We propose SNN topological modifications leading to 1.24x and 10x reduction in the neuronal module's area and the overall energy-delay-product value, respectively. Furthermore, in this work, we perform a holistic comparison between IMC implemented ANN and SNNs and conclude that lower number of time-steps are the key to achieve higher throughput and energy-efficiency for SNNs compared to 4-bit ANNs.


title: Ion kinetic effects and instabilities in the plasma flow in the magnetic mirror

abstract: Kinetic effects in plasma flow due to a finite ion temperature and ion reflections in a converging-diverging magnetic nozzle are investigated with collisionless quasineutral hybrid simulations with kinetic ions and isothermal Boltzmann electrons. It is shown that in the cold ions limit the velocity profile of the particles agrees well with the analytical theory predicting the formation of the global accelerating potential due to the magnetic mirror with the maximum of the magnetic field and resulting in the transonic ion velocity profile. The global transonic ion velocity profile is also obtained for warm ions with isotropic and anisotropic distributions. Partial ion reflections are observed due to a combined effect of the magnetic mirror and time-dependent fluctuations of the potential as a result of the wave breaking and instabilities in the regions when the fluid solutions become multi-valued. Despite partial reflections, the flow of the passing ions still follows the global accelerating profile defined by the magnetic field profile. In simulations with reflecting boundary conditions imitating the plasma source and allowing the transitions between trapped and passing ions, the global nature of the transonic accelerating solution is revealed as a constraint on the plasma exhaust velocity that ultimately defines plasma density in the source region.


title: Magnetic-Flux-Flow Diagrams for Design and Analysis of Josephson Junction Circuits

abstract: Josephson junction circuits, such as superconducting quantum interference devices (SQUIDs) and single-flux-quantum (SFQ) circuits, have been applied in both analog and digital systems for their ultralow-noise, high-speed, and power-efficient features. However, their analyses are not well supported by the conventional circuit diagrams and the charge-based analysis methods, due to the Josephson effects and flux quantization phenomena. This article introduces a type of magnetic-flux-flow (MFF) diagrams for the design and analysis of Josephson junction circuits. The MFF diagram of a Josephson junction circuit is the graphical expression of circuit equations. It not only gives the behaviors of Josephson junctions and superconducting loops new physical meanings, but also visualizes how the flux quanta are transferred among superconducting loops. The advantages of MFF diagrams are demonstrated in the design and analysis of typical Josephson junction circuits. It is shown that the MFF diagram and flux-based analysis method are the indispensable complement to the conventional circuit methodologies for Josephson junction circuits.


title: Event-Centric Question Answering via Contrastive Learning and Invertible Event Transformation

abstract: Human reading comprehension often requires reasoning of event semantic relations in narratives, represented by Event-centric Question-Answering (QA). To address event-centric QA, we propose a novel QA model with contrastive learning and invertible event transformation, call TranCLR. Our proposed model utilizes an invertible transformation matrix to project semantic vectors of events into a common event embedding space, trained with contrastive learning, and thus naturally inject event semantic knowledge into mainstream QA pipelines. The transformation matrix is fine-tuned with the annotated event relation types between events that occurred in questions and those in answers, using event-aware question vectors. Experimental results on the Event Semantic Relation Reasoning (ESTER) dataset show significant improvements in both generative and extractive settings compared to the existing strong baselines, achieving over 8.4% gain in the token-level F1 score and 3.0% gain in Exact Match (EM) score under the multi-answer setting. Qualitative analysis reveals the high quality of the generated answers by TranCLR, demonstrating the feasibility of injecting event knowledge into QA model learning. Our code and models can be found at https://github.com/LuJunru/TranCLR.


title: Gallery Filter Network for Person Search

abstract: In person search, we aim to localize a query person from one scene in other gallery scenes. The cost of this search operation is dependent on the number of gallery scenes, making it beneficial to reduce the pool of likely scenes. We describe and demonstrate the Gallery Filter Network (GFN), a novel module which can efficiently discard gallery scenes from the search process, and benefit scoring for persons detected in remaining scenes. We show that the GFN is robust under a range of different conditions by testing on different retrieval sets, including cross-camera, occluded, and low-resolution scenarios. In addition, we develop the base SeqNeXt person search model, which improves and simplifies the original SeqNet model. We show that the SeqNeXt+GFN combination yields significant performance gains over other state-of-the-art methods on the standard PRW and CUHK-SYSU person search datasets. To aid experimentation for this and other models, we provide standardized tooling for the data processing and evaluation pipeline typically used for person search research.


title: Exploring the Early Afterglow Polarization of GRB 190829A

abstract: The GRB 190829A has been widely studied due to its nature and the high energy emission presented. Due to the detection of a very-high-energy component by the High Energy Stereoscopic System and the event's atypically middling luminosity, it has been categorized in a select, limited group of bursts bordering classic GRBs and nearby sub-energetic events. Given the range of models utilized to adequately characterize the afterglow of this burst, it has proven challenging to identify the most probable explanation. Nevertheless, the detection of polarization data provided by the MASTER collaboration has added a new aspect to GRB 190829A that permits us to attempt to explore this degeneracy. In this paper, we present a polarization model coupled with a synchrotron forward-shock model -- a component in all models used to describe GRB 190829A's afterglow -- in order to fit the polarization's temporal evolution with the existing upper limits ($\Pi < 6\%$). We find that the polarization generated from an on-axis emission is favored for strongly anisotropic magnetic field ratios, while an off-axis scenario cannot be fully ruled out when a more isotropic framework is taken into account.


title: Visualizing the Obvious: A Concreteness-based Ensemble Model for Noun Property Prediction

abstract: Neural language models encode rich knowledge about entities and their relationships which can be extracted from their representations using probing. Common properties of nouns (e.g., red strawberries, small ant) are, however, more challenging to extract compared to other types of knowledge because they are rarely explicitly stated in texts. We hypothesize this to mainly be the case for perceptual properties which are obvious to the participants in the communication. We propose to extract these properties from images and use them in an ensemble model, in order to complement the information that is extracted from language models. We consider perceptual properties to be more concrete than abstract properties (e.g., interesting, flawless). We propose to use the adjectives' concreteness score as a lever to calibrate the contribution of each source (text vs. images). We evaluate our ensemble model in a ranking task where the actual properties of a noun need to be ranked higher than other non-relevant properties. Our results show that the proposed combination of text and images greatly improves noun property prediction compared to powerful text-based language models.


title: Iterative Detection and Decoding for Cell-Free Massive Multiuser MIMO with LDPC Codes

abstract: This paper proposes an iterative detection and decoding (IDD) scheme for a cell free massive multiple input multiple output (CF-mMIMO) system. Users send coded data to the access points (APs), which is jointly detected at central processing unit (CPU). The symbols are exchanged iteratively in the form of log likelihood ratios (LLRs) between the detector and the low-density parity check codes (LPDC) decoder, increasing the coded system's performance. We propose a list-based multi-feedback diversity with successive interference cancellation (MF-SIC) to improve the performance of the CF-mMIMO. Furthermore, the proposed detector is compared with the parallel interference cancellation (PIC) and MF-PIC schemes. Finally, the bit error rate (BER) performance of CF-mMIMO is compared with the co-located mMIMO (Col-mMIMO).


title: Super-resolution simulation of the Fuzzy Dark Matter cosmological model

abstract: AI super-resolution, combining deep learning and N-body simulations has been shown to successfully reproduce the large scale structure and halo abundances in the Lambda Cold Dark Matter cosmological model. Here, we extend its use to models with a different dark matter content, in this case Fuzzy Dark Matter (FDM), in the approximation that the difference is encoded in the initial power spectrum. We focus on redshift z = 2, with simulations that model smaller scales and lower masses, the latter by two orders of magnitude, than has been done in previous AI super-resolution work. We find that the super-resolution technique can reproduce the power spectrum and halo mass function to within a few percent of full high resolution calculations. We also find that halo artifacts, caused by spurious numerical fragmentation of filaments, are equally present in the super-resolution outputs. Although we have not trained the super-resolution algorithm using full quantum pressure FDM simulations, the fact that it performs well at the relevant length and mass scales means that it has promise as technique which could avoid the very high computational cost of the latter, in some contexts. We conclude that AI super-resolution can become a useful tool to extend the range of dark matter models covered in mock catalogs.


title: Predicting the Citation Count and CiteScore of Journals One Year in Advance

abstract: Prediction of the future performance of academic journals is a task that can benefit a variety of stakeholders including editorial staff, publishers, indexing services, researchers, university administrators and granting agencies. Using historical data on journal performance, this can be framed as a machine learning regression problem. In this work, we study two such regression tasks: 1) prediction of the number of citations a journal will receive during the next calendar year, and 2) prediction of the Elsevier CiteScore a journal will be assigned for the next calendar year. To address these tasks, we first create a dataset of historical bibliometric data for journals indexed in Scopus. We propose the use of neural network models trained on our dataset to predict the future performance of journals. To this end, we perform feature selection and model configuration for a Multi-Layer Perceptron and a Long Short-Term Memory. Through experimental comparisons to heuristic prediction baselines and classical machine learning models, we demonstrate superior performance in our proposed models for the prediction of future citation and CiteScore values.


title: Environment-mediated entropic uncertainty in charging quantum batteries

abstract: We studied the dynamics of entropic uncertainty in Markovian and non-Markovian systems during the charging of open quantum batteries (QBs) mediated by a common dissipation environment. In the non-Markovian regime, the battery is almost fully charged efficiently, and the strong non-Markovian property is beneficial for improving the charging power. In addition, the results show that the energy storage is closely related to the couplings of the charger-reservoir and battery-reservoir; that is, the stronger coupling of a charger-reservoir improves energy storage. In particular, entanglement is required to obtain the most stored energy and is accompanied by the least tight entropic bound. Interestingly, it was found that the tightness of the entropic bound can be considered a good indicator of the energy transfer in different charging processes, and the complete energy transfer always corresponds to the tightest entropic bound. Our results provide insight into the optimal charging efficiency of QBs during practical charging.


title: Specializing Multi-domain NMT via Penalizing Low Mutual Information

abstract: Multi-domain Neural Machine Translation (NMT) trains a single model with multiple domains. It is appealing because of its efficacy in handling multiple domains within one model. An ideal multi-domain NMT should learn distinctive domain characteristics simultaneously, however, grasping the domain peculiarity is a non-trivial task. In this paper, we investigate domain-specific information through the lens of mutual information (MI) and propose a new objective that penalizes low MI to become higher. Our method achieved the state-of-the-art performance among the current competitive multi-domain NMT models. Also, we empirically show our objective promotes low MI to be higher resulting in domain-specialized multi-domain NMT.


title: Normalized solutions to Kirchhoff type equations with a critical growth nonlinearity

abstract: In this paper, we are concerned with normalized solutions of the Kirchhoff type equation \begin{equation*} -M\left(\int_{\R^N}|\nabla u|^2\mathrm{d} x\right)\Delta u = \lambda u +f(u) \ \ \mathrm{in} \ \ \mathbb{R}^N \end{equation*} with $u \in S_c:=\left\{u \in H^1(\R^N): \int_{\R^N}u^2 \mathrm{d}x=c^2\right\}$. When $N=2$ and $f$ has exponential critical growth at infinity, normalized mountain pass type solutions are obtained via the variational methods. When $N \ge 4$, $M(t)=a+bt$ with $a$, $b>0$ and $f$ has Sobolev critical growth at infinity, we investigate the existence of normalized ground state solutions and normalized mountain pass type solutions. Moreover, the non-existence of normalized solutions is also considered.


title: Synchronization in a Kuramoto Mean Field Game

abstract: The classical Kuramoto model is studied in the setting of an infinite horizon mean field game. The system is shown to exhibit both synchronization and phase transition. Incoherence below a critical value of the interaction parameter is demonstrated by the stability of the uniform distribution. Above this value, the game bifurcates and develops self-organizing time homogeneous Nash equilibria. As interactions become stronger, these stationary solutions become fully synchronized. Results are proved by an amalgam of techniques from nonlinear partial differential equations, viscosity solutions, stochastic optimal control and stochastic processes.


title: Determinants of matrices related to the Pascal triangle

abstract: In this note we prove an assertion made by M. Levin in 1999: the Pascal matrix modulo 2 has the property that each of the square sub-matrices laying on the upper border or on the left border has determinants, computed in $\mathbb{Z}$, equal to 1 or -1.


title: A Novel Adaptive Causal Sampling Method for Physics-Informed Neural Networks

abstract: Physics-Informed Neural Networks (PINNs) have become a kind of attractive machine learning method for obtaining solutions of partial differential equations (PDEs). Training PINNs can be seen as a semi-supervised learning task, in which only exact values of initial and boundary points can be obtained in solving forward problems, and in the whole spatio-temporal domain collocation points are sampled without exact labels, which brings training difficulties. Thus the selection of collocation points and sampling methods are quite crucial in training PINNs. Existing sampling methods include fixed and dynamic types, and in the more popular latter one, sampling is usually controlled by PDE residual loss. We point out that it is not sufficient to only consider the residual loss in adaptive sampling and sampling should obey temporal causality. We further introduce temporal causality into adaptive sampling and propose a novel adaptive causal sampling method to improve the performance and efficiency of PINNs. Numerical experiments of several PDEs with high-order derivatives and strong nonlinearity, including Cahn Hilliard and KdV equations, show that the proposed sampling method can improve the performance of PINNs with few collocation points. We demonstrate that by utilizing such a relatively simple sampling method, prediction performance can be improved up to two orders of magnitude compared with state-of-the-art results with almost no extra computation cost, especially when points are limited.


title: Robust Ellipse Fitting Based on Maximum Correntropy Criterion With Variable Center

abstract: The presence of outliers can significantly degrade the performance of ellipse fitting methods. We develop an ellipse fitting method that is robust to outliers based on the maximum correntropy criterion with variable center (MCC-VC), where a Laplacian kernel is used. For single ellipse fitting, we formulate a non-convex optimization problem to estimate the kernel bandwidth and center and divide it into two subproblems, each estimating one parameter. We design sufficiently accurate convex approximation to each subproblem such that computationally efficient closed-form solutions are obtained. The two subproblems are solved in an alternate manner until convergence is reached. We also investigate coupled ellipses fitting. While there exist multiple ellipses fitting methods that can be used for coupled ellipses fitting, we develop a couple ellipses fitting method by exploiting the special structure. Having unknown association between data points and ellipses, we introduce an association vector for each data point and formulate a non-convex mixed-integer optimization problem to estimate the data associations, which is approximately solved by relaxing it into a second-order cone program. Using the estimated data associations, we extend the proposed method to achieve the final coupled ellipses fitting. The proposed method is shown to have significantly better performance over the existing methods in both simulated data and real images.


title: Explaining epsilon in local differential privacy through the lens of quantitative information flow

abstract: The study of leakage measures for privacy has been a subject of intensive research and is an important aspect of understanding how privacy leaks occur in computer systems. Differential privacy has been a focal point in the privacy community for some years and yet its leakage characteristics are not completely understood. In this paper we bring together two areas of research -- information theory and the g-leakage framework of quantitative information flow (QIF) -- to give an operational interpretation for the epsilon parameter of local differential privacy. We find that epsilon emerges as a capacity measure in both frameworks; via (log)-lift, a popular measure in information theory; and via max-case g-leakage, which we introduce to describe the leakage of any system to Bayesian adversaries modelled using ``worst-case'' assumptions under the QIF framework. Our characterisation resolves an important question of interpretability of epsilon and consolidates a number of disparate results covering the literature of both information theory and quantitative information flow.


title: A Comparative Qualitative and Quantitative Analysis of the Performance of Security Options for Message Protocols: Fog Computing Scenario

abstract: We analyze the utilization of publish-subscribe protocols in IoT and Fog Computing and challenges around security configuration, performance, and qualitative characteristics. Such problems with security configuration lead to significant disruptions and high operation costs. Yet, These issues can be prevented by selecting the appropriate transmission technology for each configuration, considering the variations in sizing, installation, sensor profile, distribution, security, networking, and locality. This work aims to present a comparative qualitative and quantitative analysis around diverse configurations, focusing on Smart Agriculture's scenario and specifically the case of fish-farming. As result, we applied a data generation workbench to create datasets of relevant research data and compared the results in terms of performance, resource utilization, security, and resilience. Also, we provide a qualitative analysis of use case scenarios for the quantitative data produced. As a contribution, this robust analysis provides a blueprint to decision support for Fog Computing engineers analyzing the best protocol to apply in various configurations.


title: Unsupervised Object Representation Learning using Translation and Rotation Group Equivariant VAE

abstract: In many imaging modalities, objects of interest can occur in a variety of locations and poses (i.e. are subject to translations and rotations in 2d or 3d), but the location and pose of an object does not change its semantics (i.e. the object's essence). That is, the specific location and rotation of an airplane in satellite imagery, or the 3d rotation of a chair in a natural image, or the rotation of a particle in a cryo-electron micrograph, do not change the intrinsic nature of those objects. Here, we consider the problem of learning semantic representations of objects that are invariant to pose and location in a fully unsupervised manner. We address shortcomings in previous approaches to this problem by introducing TARGET-VAE, a translation and rotation group-equivariant variational autoencoder framework. TARGET-VAE combines three core innovations: 1) a rotation and translation group-equivariant encoder architecture, 2) a structurally disentangled distribution over latent rotation, translation, and a rotation-translation-invariant semantic object representation, which are jointly inferred by the approximate inference network, and 3) a spatially equivariant generator network. In comprehensive experiments, we show that TARGET-VAE learns disentangled representations without supervision that significantly improve upon, and avoid the pathologies of, previous methods. When trained on images highly corrupted by rotation and translation, the semantic representations learned by TARGET-VAE are similar to those learned on consistently posed objects, dramatically improving clustering in the semantic latent space. Furthermore, TARGET-VAE is able to perform remarkably accurate unsupervised pose and location inference. We expect methods like TARGET-VAE will underpin future approaches for unsupervised object generation, pose prediction, and object detection.


title: Impact of droplets onto surfactant-laden thin liquid films

abstract: We study the effect of insoluble surfactants on the impact of surfactant-free droplets on surfactant-laden thin liquid films via a fully three-dimensional direct numerical simulations approach that employs a hybrid interface-tracking/level-set method, and by taking into account surfactant-induced Marangoni stresses due to gradients in interfacial surfactant concentration. Our numerical predictions for the temporal evolution of the surfactant-free crown are validated against the experimental work by Che and Matar (2017). We focus on the crown-splash regime, and we observe that the crown dynamics evolves through various stages: from the the growth of linear modes (through a Rayleigh- Plateau instability) to the development of nonlinearities leading to primary and secondary breakup events (through droplet shedding modulated by an end-pinching mechanism). We show that the addition of surfactants does not affect the wave selection via the Rayleigh-Plateau instability. However, the presence of surfactants plays a key role in the late stages of the dynamics as soon as the ligaments are driven out from the rim. Surfactant-induced Marangoni stresses delay the end-pinching mechanisms to result in longer ligaments prior to their capillary singularity, while also promoting the spanwise merging between ligaments. Finally, we show that the addition of surfactants leads to surface rigidification and consequently to the retardation of the flow dynamics.


title: Efficient User Scheduling for Uplink Hybrid Satellite-Terrestrial Communication

abstract: Due to increasing demands of seamless connection and massive information exchange across the world, the integrated satellite-terrestrial communication systems develop rapidly. To shed lights on the design of this system, we consider an uplink communication model consisting of a single satellite, a single terrestrial station and multiple ground users. The terrestrial station uses decode-and-forward (DF) to facilitate the communication between ground users and the satellite. The channel between the satellite and the terrestrial station is assumed to be a quasi-static shadowed Rician fading channel, while the channels between the terrestrial station and ground users are assumed to experience independent quasi-static Rayleigh fading. We consider two cases of channel state information (CSI) availability. When instantaneous CSI is available, we derive the instantaneous achievable sum rate of all ground users and formulate an optimization problem to maximize the sum rate. When only channel distribution information (CDI) is available, we derive a closed-form expression for the outage probability and formulate another optimization problem to minimize the outage probability. Both optimization problems correspond to scheduling algorithms for ground users. For both cases, we propose low-complexity user scheduling algorithms and demonstrate the efficiency of our scheduling algorithms via numerical simulations.


title: Investigating self-supervised, weakly supervised and fully supervised training approaches for multi-domain automatic speech recognition: a study on Bangladeshi Bangla

abstract: Despite huge improvements in automatic speech recognition (ASR) employing neural networks, ASR systems still suffer from a lack of robustness and generalizability issues due to domain shifting. This is mainly because principal corpus design criteria are often not identified and examined adequately while compiling ASR datasets. In this study, we investigate the robustness of the state-of-the-art transfer learning approaches such as self-supervised wav2vec 2.0 and weakly supervised Whisper as well as fully supervised convolutional neural networks (CNNs) for multi-domain ASR. We also demonstrate the significance of domain selection while building a corpus by assessing these models on a novel multi-domain Bangladeshi Bangla ASR evaluation benchmark - BanSpeech, which contains approximately 6.52 hours of human-annotated speech and 8085 utterances from 13 distinct domains. SUBAK.KO, a mostly read speech corpus for the morphologically rich language Bangla, has been used to train the ASR systems. Experimental evaluation reveals that self-supervised cross-lingual pre-training is the best strategy compared to weak supervision and full supervision to tackle the multi-domain ASR task. Moreover, the ASR models trained on SUBAK.KO face difficulty recognizing speech from domains with mostly spontaneous speech. The BanSpeech will be publicly available to meet the need for a challenging evaluation benchmark for Bangla ASR.


title: BARS: A Benchmark for Airport Runway Segmentation

abstract: Airport runway segmentation can effectively reduce the accident rate during the landing phase, which has the largest risk of flight accidents. With the rapid development of deep learning (DL), related methods achieve good performance on segmentation tasks and can be well adapted to complex scenes. However, the lack of large-scale, publicly available datasets in this field makes the development of methods based on DL difficult. Therefore, we propose a benchmark for airport runway segmentation, named BARS. Additionally, a semiautomatic annotation pipeline is designed to reduce the annotation workload. BARS has the largest dataset with the richest categories and the only instance annotation in the field. The dataset, which was collected using the X-Plane simulation platform, contains 10,256 images and 30,201 instances with three categories. We evaluate eleven representative instance segmentation methods on BARS and analyze their performance. Based on the characteristic of an airport runway with a regular shape, we propose a plug-and-play smoothing postprocessing module (SPM) and a contour point constraint loss (CPCL) function to smooth segmentation results for mask-based and contour-based methods, respectively. Furthermore, a novel evaluation metric named average smoothness (AS) is developed to measure smoothness. The experiments show that existing instance segmentation methods can achieve prediction results with good performance on BARS. SPM and CPCL can effectively enhance the AS metric while modestly improving accuracy. Our work will be available at https://github.com/c-wenhui/BARS.


title: Notes on Frobenius stable direct images

abstract: In this note, we prove the coherence of Frobenius stable direct images in a new case. We also show a generation theorem regarding to it. Furthermore, we prove a corresponding theorem in characteristic zero.


title: OLLA: Optimizing the Lifetime and Location of Arrays to Reduce the Memory Usage of Neural Networks

abstract: The size of deep neural networks has grown exponentially in recent years. Unfortunately, hardware devices have not kept pace with the rapidly increasing memory requirements. To cope with this, researchers have turned to techniques such as spilling and recomputation, which increase training time, or reduced precision and model pruning, which can affect model accuracy. We present OLLA, an algorithm that optimizes the lifetime and memory location of the tensors used to train neural networks. Our method reduces the memory usage of existing neural networks, without needing any modification to the models or their training procedures. We formulate the problem as a joint integer linear program (ILP). We present several techniques to simplify the encoding of the problem, and enable our approach to scale to the size of state-of-the-art neural networks using an off-the-shelf ILP solver. We experimentally demonstrate that OLLA only takes minutes if not seconds to allow the training of neural networks using one-third less memory on average.


title: TIARA: Multi-grained Retrieval for Robust Question Answering over Large Knowledge Bases

abstract: Pre-trained language models (PLMs) have shown their effectiveness in multiple scenarios. However, KBQA remains challenging, especially regarding coverage and generalization settings. This is due to two main factors: i) understanding the semantics of both questions and relevant knowledge from the KB; ii) generating executable logical forms with both semantic and syntactic correctness. In this paper, we present a new KBQA model, TIARA, which addresses those issues by applying multi-grained retrieval to help the PLM focus on the most relevant KB contexts, viz., entities, exemplary logical forms, and schema items. Moreover, constrained decoding is used to control the output space and reduce generation errors. Experiments over important benchmarks demonstrate the effectiveness of our approach. TIARA outperforms previous SOTA, including those using PLMs or oracle entity annotations, by at least 4.1 and 1.1 F1 points on GrailQA and WebQuestionsSP, respectively.


title: Exploring Euphemism Detection in Few-Shot and Zero-Shot Settings

abstract: This work builds upon the Euphemism Detection Shared Task proposed in the EMNLP 2022 FigLang Workshop, and extends it to few-shot and zero-shot settings. We demonstrate a few-shot and zero-shot formulation using the dataset from the shared task, and we conduct experiments in these settings using RoBERTa and GPT-3. Our results show that language models are able to classify euphemistic terms relatively well even on new terms unseen during training, indicating that it is able to capture higher-level concepts related to euphemisms.


title: The Design and Realization of Multi-agent Obstacle Avoidance based on Reinforcement Learning

abstract: Intelligence agents and multi-agent systems play important roles in scenes like the control system of grouped drones, and multi-agent navigation and obstacle avoidance which is the foundational function of advanced application has great importance. In multi-agent navigation and obstacle avoidance tasks, the decision-making interactions and dynamic changes of agents are difficult for traditional route planning algorithms or reinforcement learning algorithms with the increased complexity of the environment. The classical multi-agent reinforcement learning algorithm, Multi-agent deep deterministic policy gradient(MADDPG), solved precedent algorithms' problems of having unstationary training process and unable to deal with environment randomness. However, MADDPG ignored the temporal message hidden beneath agents' interaction with the environment. Besides, due to its CTDE technique which let each agent's critic network to calculate over all agents' action and the whole environment information, it lacks ability to scale to larger amount of agents. To deal with MADDPG's ignorance of the temporal information of the data, this article proposes a new algorithm called MADDPG-LSTMactor, which combines MADDPG with Long short term memory (LSTM). By using agent's observations of continuous timesteps as the input of its policy network, it allows the LSTM layer to process the hidden temporal message. Experimental result demonstrated that this algorithm had better performance in scenarios where the amount of agents is small. Besides, to solve MADDPG's drawback of not being efficient in scenarios where agents are too many, this article puts forward a light-weight MADDPG (MADDPG-L) algorithm, which simplifies the input of critic network. The result of experiments showed that this algorithm had better performance than MADDPG when the amount of agents was large.


title: GFlowOut: Dropout with Generative Flow Networks

abstract: Bayesian Inference offers principled tools to tackle many critical problems with modern neural networks such as poor calibration and generalization, and data inefficiency. However, scaling Bayesian inference to large architectures is challenging and requires restrictive approximations. Monte Carlo Dropout has been widely used as a relatively cheap way for approximate Inference and to estimate uncertainty with deep neural networks. Traditionally, the dropout mask is sampled independently from a fixed distribution. Recent works show that the dropout mask can be viewed as a latent variable, which can be inferred with variational inference. These methods face two important challenges: (a) the posterior distribution over masks can be highly multi-modal which can be difficult to approximate with standard variational inference and (b) it is not trivial to fully utilize sample-dependent information and correlation among dropout masks to improve posterior estimation. In this work, we propose GFlowOut to address these issues. GFlowOut leverages the recently proposed probabilistic framework of Generative Flow Networks (GFlowNets) to learn the posterior distribution over dropout masks. We empirically demonstrate that GFlowOut results in predictive distributions that generalize better to out-of-distribution data, and provide uncertainty estimates which lead to better performance in downstream tasks.


title: Finding Memo: Extractive Memorization in Constrained Sequence Generation Tasks

abstract: Memorization presents a challenge for several constrained Natural Language Generation (NLG) tasks such as Neural Machine Translation (NMT), wherein the proclivity of neural models to memorize noisy and atypical samples reacts adversely with the noisy (web crawled) datasets. However, previous studies of memorization in constrained NLG tasks have only focused on counterfactual memorization, linking it to the problem of hallucinations. In this work, we propose a new, inexpensive algorithm for extractive memorization (exact training data generation under insufficient context) in constrained sequence generation tasks and use it to study extractive memorization and its effects in NMT. We demonstrate that extractive memorization poses a serious threat to NMT reliability by qualitatively and quantitatively characterizing the memorized samples as well as the model behavior in their vicinity. Based on empirical observations, we develop a simple algorithm which elicits non-memorized translations of memorized samples from the same model, for a large fraction of such samples. Finally, we show that the proposed algorithm could also be leveraged to mitigate memorization in the model through finetuning. We have released the code to reproduce our results at https://github.com/vyraun/Finding-Memo.


title: Social norms of fairness with reputation-based role assignment in the dictator game

abstract: A vast body of experiments share the view that social norms are major factors for the emergence of fairness in a population of individuals playing the dictator game (DG). Recently, to explore which social norms are conducive to sustaining cooperation has obtained considerable concern. However, thus far few studies have investigated how social norms influence the evolution of fairness by means of indirect reciprocity. In this study, we propose an indirect reciprocal model of the DG and consider that an individual can be assigned as the dictator due to its good reputation. We investigate the `leading eight' norms and all second-order social norms by a two-timescale theoretical analysis. We show that when role assignment is based on reputation, four of the `leading eight' norms, including stern judging and simple standing, lead to a high level of fairness, which increases with the selection intensity. Our work also reveals that not only the correct treatment of making a fair split with good recipients but also distinguishing unjustified unfair split from justified unfair split matters in elevating the level of fairness.


title: Removing Radio Frequency Interference from Auroral Kilometric Radiation with Stacked Autoencoders

abstract: Radio frequency data in astronomy enable scientists to analyze astrophysical phenomena. However, these data can be corrupted by radio frequency interference (RFI) that limits the observation of underlying natural processes. In this study, we extend recent developments in deep learning algorithms to astronomy data. We remove RFI from time-frequency spectrograms containing auroral kilometric radiation (AKR), a coherent radio emission originating from the Earth's auroral zones that is used to study astrophysical plasmas. We propose a Denoising Autoencoder for Auroral Radio Emissions (DAARE) trained with synthetic spectrograms to denoise AKR signals collected at the South Pole Station. DAARE achieves 42.2 peak signal-to-noise ratio (PSNR) and 0.981 structural similarity (SSIM) on synthesized AKR observations, improving PSNR by 3.9 and SSIM by 0.064 compared to state-of-the-art filtering and denoising networks. Qualitative comparisons demonstrate DAARE's capability to effectively remove RFI from real AKR observations, despite being trained completely on a dataset of simulated AKR. The framework for simulating AKR, training DAARE, and employing DAARE can be accessed at github.com/Cylumn/daare.


title: Loop braid groups and integrable models

abstract: Loop braid groups characterize the exchange of extended objects, namely loops, in three dimensional space generalizing the notion of braid groups that describe the exchange of point particles in two dimensional space. Their interest in physics stems from the fact that they capture anyonic statistics in three dimensions which is otherwise known to only exist for point particles on the plane. Here we explore another direction where the algebraic relations of the loop braid groups can play a role -- quantum integrable models. We show that the {\it symmetric loop braid group} can naturally give rise to solutions of the Yang--Baxter equation, proving the integrability of certain models through the RTT relation. For certain representations of the symmetric loop braid group we obtain integrable deformations of the $XXX$-, $XXZ$- and $XYZ$-spin chains.

categories: math-ph cond-mat.stat-mech hep-th math.MP nlin.SI


title: Multi-Agent Path Finding via Tree LSTM

abstract: In recent years, Multi-Agent Path Finding (MAPF) has attracted attention from the fields of both Operations Research (OR) and Reinforcement Learning (RL). However, in the 2021 Flatland3 Challenge, a competition on MAPF, the best RL method scored only 27.9, far less than the best OR method. This paper proposes a new RL solution to Flatland3 Challenge, which scores 125.3, several times higher than the best RL solution before. We creatively apply a novel network architecture, TreeLSTM, to MAPF in our solution. Together with several other RL techniques, including reward shaping, multiple-phase training, and centralized control, our solution is comparable to the top 2-3 OR methods.


title: Orbital hybridization-driven charge density wave transition in CsV3Sb5 kagome superconductor

abstract: Owing to its inherent non-trivial geometry, the unique structural motif of the recently discovered Kagome topological superconductor AV3Sb5 is an ideal host of diverse topologically non-trivial phenomena, including giant anomalous Hall conductivity, topological charge order, charge density wave, and unconventional superconductivity. Despite possessing a normal-state CDW order in the form of topological chiral charge order and diverse superconducting gaps structures, it remains unclear how fundamental atomic-level properties and many-body effects including Fermi surface nesting, electron-phonon coupling, and orbital hybridization contribute to these symmetry-breaking phenomena. Here, we report the direct participation of the V3d-Sb5p orbital hybridization in mediating the CDW phase transition in CsV3Sb5. The combination of temperature-dependent X-ray absorption and first principles studies clearly indicate the Inverse Star of David structure as the preferred reconstruction in the low-temperature CDW phase. Our results highlight the critical role that Sb orbitals plays and establish orbital hybridization as the direct mediator of the CDW states and structural transition dynamics in Kagome unconventional superconductors. This is a significant step towards the fundamental understanding and control of the emerging correlated phases from the Kagome lattice through the orbital interactions and provide promising approaches to novel regimes in unconventional orders and topology.


title: 360-MLC: Multi-view Layout Consistency for Self-training and Hyper-parameter Tuning

abstract: We present 360-MLC, a self-training method based on multi-view layout consistency for finetuning monocular room-layout models using unlabeled 360-images only. This can be valuable in practical scenarios where a pre-trained model needs to be adapted to a new data domain without using any ground truth annotations. Our simple yet effective assumption is that multiple layout estimations in the same scene must define a consistent geometry regardless of their camera positions. Based on this idea, we leverage a pre-trained model to project estimated layout boundaries from several camera views into the 3D world coordinate. Then, we re-project them back to the spherical coordinate and build a probability function, from which we sample the pseudo-labels for self-training. To handle unconfident pseudo-labels, we evaluate the variance in the re-projected boundaries as an uncertainty value to weight each pseudo-label in our loss function during training. In addition, since ground truth annotations are not available during training nor in testing, we leverage the entropy information in multiple layout estimations as a quantitative metric to measure the geometry consistency of the scene, allowing us to evaluate any layout estimator for hyper-parameter tuning, including model selection without ground truth annotations. Experimental results show that our solution achieves favorable performance against state-of-the-art methods when self-training from three publicly available source datasets to a unique, newly labeled dataset consisting of multi-view of the same scenes.


title: Selecting and Composing Learning Rate Policies for Deep Neural Networks

abstract: The choice of learning rate (LR) functions and policies has evolved from a simple fixed LR to the decaying LR and the cyclic LR, aiming to improve the accuracy and reduce the training time of Deep Neural Networks (DNNs). This paper presents a systematic approach to selecting and composing an LR policy for effective DNN training to meet desired target accuracy and reduce training time within the pre-defined training iterations. It makes three original contributions. First, we develop an LR tuning mechanism for auto-verification of a given LR policy with respect to the desired accuracy goal under the pre-defined training time constraint. Second, we develop an LR policy recommendation system (LRBench) to select and compose good LR policies from the same and/or different LR functions through dynamic tuning, and avoid bad choices, for a given learning task, DNN model and dataset. Third, we extend LRBench by supporting different DNN optimizers and show the significant mutual impact of different LR policies and different optimizers. Evaluated using popular benchmark datasets and different DNN models (LeNet, CNN3, ResNet), we show that our approach can effectively deliver high DNN test accuracy, outperform the existing recommended default LR policies, and reduce the DNN training time by 1.6$\sim$6.7$\times$ to meet a targeted model accuracy.


title: Isoparametric hypersurfaces and hypersurfaces with constant principal curvatures in Finsler spaces

abstract: In this paper, we study the relationship between isoparametric hypersurfaces and hypersurfaces with constant principal curvatures in Finsler spaces. We give some examples of isoparametric hypersurfaces with (non)constant principal curvatures on Randers manifolds with nonconstant flag curvatures. Furthermore, we construct an example of a conformally flat Randers manifold which admits a family of nonisoparametric hyperplanes with constant principal curvatures.