title: Tsallis entropy for cross-shareholding network configurations

abstract: In this work, we develop the Tsallis entropy approach for examining the cross-shareholding network of companies traded on the Italian stock market. In such a network, the nodes represent the companies, and the links represent the ownership. Within this context, we introduce the out-degree of the nodes -- which represents the diversification -- and the in-degree of them -- capturing the integration. Diversification and integration allow a clear description of the industrial structure formed by the considered companies. The stochastic dependence of diversification and integration is modelled through copulas. We argue that copulas are well suited for modelling the joint distribution. The analysis of the stochastic dependence between integration and diversification by means of the Tsallis entropy gives a crucial information on the reaction of the market structure to the external shocks, - on the basis of some relevant cases of dependence between the considered variables. In this respect, the considered entropy framework provides insights on the relationship between in-degree and out-degree dependence structure and market polarisation or fairness. Moreover, the interpretation of the results in the light of the Tsallis entropy parameter gives relevant suggestions for policymakers who aim at shaping the industrial context for having high polarisation or fair joint distribution of diversification and integration. Furthermore, a discussion of possible parametrisations of the in-degree and out-degree marginal distribution, -- by means of power laws or exponential functions, -- is also carried out. An empirical experiment on a large dataset of Italian companies validates the theoretical framework.


title: A class of fuzzy numbers induced by probability density functions and their arithmetic operations

abstract: In this paper we are interested in a class of fuzzy numbers which is uniquely identified by their membership functions. The function space, denoted by $X_{h, p}$, will be constructed by combining a class of nonlinear mappings $h$ (subjective perception) and a class of probability density functions (PDF) $p$ (objective entity), respectively. Under our assumptions, we prove that there always exists a class of $h$ to fulfill the observed outcome for a given class of $p$. Especially, we prove that the common triangular number can be interpreted by a function pair $(h, p)$. As an example, we consider a sample function space $X_{h, p}$ where $h$ is the tangent function and $p$ is chosen as the Gaussian kernel with free variable $\mu$. By means of the free variable $\mu$ (which is also the expectation of $p(x; \mu)$), we define the addition, scalar multiplication and subtraction on $X_{h, p}$. We claim that, under our definitions, $X_{h, p}$ has a linear algebra. Some numerical examples are provided to illustrate the proposed approach.


title: Applications of Traveling Salesman Problem on the Optimal Sightseeing Orders of Macao World Heritage Sites with Real Time or Distance Values Between Every Pair of Sites

abstract: The optimal route of sightseeing orders for visiting every Macao World Heritage Site at exactly once was calculated with Simulated Annealing and Metropolis Algorithm(SAMA) after considering real required time or traveling distance between pairs of sites by either driving a car, taking a bus, or on foot. We found out that, with the optimal tour path, it took roughly 78 minutes for driving a car, 115 minutes on foot, while 117 minutes for taking a bus. On the other hand, the optimal total distance for driving a car would be 13.918 km while for pedestrians to walk, 7.844 km. These results probably mean that there is large space for the improvement on public transportation in this city. Comparison of computation time demanded between the brute-force enumeration of all possible paths and SAMA was also presented, together with animation of the processes for the algorithm to find out the optimal route. It is expected that computation time is astronomically increasing for the brute-force enumeration with more number of sites, while it only takes SAMA much less order of magnitude in time to calculate the optimal solution for larger number of sites. Several optimal options of routes were also provided in each transportation method. However, it is possible that in some types of transportation there could be only one optimal route having no circular or mirrored duplicates.


title: Conducting more inclusive solar geoengineering research: A feminist science framework

abstract: Solar geoengineering, or deliberate climate modification, has been receiving increased attention in recent years. Given the far-reaching consequences of any potential solar geoengineering deployments, it is prudent to identify inherent biases, blind spots, and other potential issues at all stages of the research process. Here we articulate a feminist science-based framework to concretely describe how solar geoengineering researchers can be more inclusive of different perspectives, in the process illuminating potential implicit bias and enhancing the conclusions that can be gained from their studies. Importantly, this framework is an adoptable method of practice that can be refined, with the aim of conducting better research in solar geoengineering. As an illustration, we retrospectively apply this framework to a well-read solar geoengineering study, improving transparency by revealing its implicit values, conclusions made from its evidence base, and the methodologies that study pursues. We conclude with a set of recommendations for the geoengineering research community whereby more inclusive research can become a regular part of practice. Throughout this process, we illustrate how feminist science scholars can use this approach to study climate modeling.


title: A multilayer network model of Covid-19: implications in public health policy in Costa Rica

abstract: Successful partnerships between researchers, experts and public health authorities has been critical to navigate the challenges of the Covid-19 pandemic worldwide. In Costa Rica, we constructed a multilayer network model that incorporates a diverse contact structure for each individual (node). The different layers which constitute the individual's contact structure include: family, friends, and sporadic interactions. Different scenarios were constructed to forecast and have a better understanding of the possible routes of the pandemic in the country, given the information that was available at the time and the different measures implemented by the health authorities of the country. Strong collaboration within our diverse team allowed using the model to tailor advice on contingency measures to health authorities. The model helped develop informed strategies to prepare the public health system in Costa Rica. The development, evolution and applications of a multilayer network model of Covid-19 in the adoption of sanitary measures in Costa Rica has been an example of the potential of such partnerships.


title: Revisiting Trends in the Exchange Current for Hydrogen Evolution

abstract: N{\o}rskov and collaborators proposed a simple kinetic model to explain the volcano relation for the hydrogen evolution reaction on transition metal surfaces in such that $ j_0= k_0 f({\Delta}G_H)$ where j_0 is the exchange current density, $f({\Delta}G_H)$ is a function of the hydrogen adsorption free energy ${\Delta}G_H$ as computed from density functional theory, and $k_0$ is a universal rate constant. Herein, focusing on the hydrogen evolution reaction in acidic medium, we revisit the original experimental data and find that the fidelity of this kinetic model can be significantly improved by invoking metal-dependence on $k_0$ such that the logarithm of $k_0$ linearly depends on the absolute value of ${\Delta}G_H$. We further confirm this relationship using additional experimental data points obtained from a critical review of the available literature. Our analyses show that the new model decreases the discrepancy between calculated and experimental exchange current density values by up to four orders of magnitude. Furthermore, we show the model can be further improved using machine learning and statistical inference methods that integrate additional material properties


title: $\ast$-Ricci-Yamabe Soliton and Contact Geometry

abstract: It is well known that a unit sphere admits Sasakian 3-structure. Also, Sasakian manifolds are locally isometric to a unit sphere under several curvature and critical conditions. So, a natural question is: Does there exist any curvature or critical condition under which a Sasakian 3-manifold represents a geometrical object other than the unit sphere? In this regard, as an extension of the $\ast$-Ricci soliton, the notion of $\ast$-Ricci-Yamabe soliton is introduced and studied on two classes contact metric manifolds. A $(2n + 1)$-dimensional non-Sasakian $N(k)$-contact metric manifold admitting $\ast$-Ricci-Yamabe soliton is completely classified. Further, it is proved that if a Sasakian 3-manifold $M$ admits $\ast$-Ricci-Yamabe soliton $(g,V,\lambda,\alpha,\beta)$ under certain conditions on the soliton vector field $V$, then $M$ is $\ast$-Ricci flat, positive Sasakian and the transverse geometry of $M$ is Fano. In addition, the Sasakian 3-metric $g$ is homothetic to a Berger sphere and the soliton is steady. Also, the potential vector field $V$ is an infinitesimal automorphism of the contact metric structure.


title: Multi-Constraint Shortest Path using Forest Hop Labeling

abstract: The \textit{Multi-Constraint Shortest Path (MCSP)} problem aims to find the shortest path between two nodes in a network subject to a given constraint set. It is typically processed as a \textit{skyline path} problem. However, the number of intermediate skyline paths becomes larger as the network size increases and the constraint number grows, which brings about the dramatical growth of computational cost and further makes the existing index-based methods hardly capable of obtaining the complete exact results. In this paper, we propose a novel high-dimensional skyline path concatenation method to avoid the expensive skyline path search, which then supports the efficient construction of hop labeling index for \textit{MCSP} queries. Specifically, a set of insightful observations and techniques are proposed to improve the efficiency of concatenating two skyline path set, a \textit{n-Cube} technique is designed to prune the concatenation space among multiple hops, and a \textit{constraint pruning} method is used to avoid the unnecessary computation. Furthermore, to scale up to larger networks, we propose a novel \textit{forest hop labeling} which enables the parallel label construction from different network partitions. Our approach is the first method that can achieve both accuracy and efficiency for \textit{MCSP} query answering. Extensive experiments on real-life road networks demonstrate the superiority of our method over the state-of-the-art solutions.


title: Learning Forceful Manipulation Skills from Multi-modal Human Demonstrations

abstract: Learning from Demonstration (LfD) provides an intuitive and fast approach to program robotic manipulators. Task parameterized representations allow easy adaptation to new scenes and online observations. However, this approach has been limited to pose-only demonstrations and thus only skills with spatial and temporal features. In this work, we extend the LfD framework to address forceful manipulation skills, which are of great importance for industrial processes such as assembly. For such skills, multi-modal demonstrations including robot end-effector poses, force and torque readings, and operation scene are essential. Our objective is to reproduce such skills reliably according to the demonstrated pose and force profiles within different scenes. The proposed method combines our previous work on task-parameterized optimization and attractor-based impedance control. The learned skill model consists of (i) the attractor model that unifies the pose and force features, and (ii) the stiffness model that optimizes the stiffness for different stages of the skill. Furthermore, an online execution algorithm is proposed to adapt the skill execution to real-time observations of robot poses, measured forces, and changed scenes. We validate this method rigorously on a 7-DoF robot arm over several steps of an E-bike motor assembly process, which require different types of forceful interaction such as insertion, sliding and twisting.


title: KELM: Knowledge Enhanced Pre-Trained Language Representations with Message Passing on Hierarchical Relational Graphs

abstract: Incorporating factual knowledge into pre-trained language models (PLM) such as BERT is an emerging trend in recent NLP studies. However, most of the existing methods combine the external knowledge integration module with a modified pre-training loss and re-implement the pre-training process on the large-scale corpus. Re-pretraining these models is usually resource-consuming, and difficult to adapt to another domain with a different knowledge graph (KG). Besides, those works either cannot embed knowledge context dynamically according to textual context or struggle with the knowledge ambiguity issue. In this paper, we propose a novel knowledge-aware language model framework based on fine-tuning process, which equips PLM with a unified knowledge-enhanced text graph that contains both text and multi-relational sub-graphs extracted from KG. We design a hierarchical relational-graph-based message passing mechanism, which can allow the representations of injected KG and text to mutually update each other and can dynamically select ambiguous mentioned entities that share the same text. Our empirical results show that our model can efficiently incorporate world knowledge from KGs into existing language models such as BERT, and achieve significant improvement on the machine reading comprehension (MRC) task compared with other knowledge-enhanced models.


title: Collisional mixing between inner and outer solar system planetesimals inferred from the Nedagolla iron meteorite

abstract: The ungrouped iron meteorite Nedagolla is the first meteorite with bulk Mo, Ru, and Ni isotopic compositions that are intermediate between those of the non-carbonaceous (NC) and carbonaceous (CC) meteorite reservoirs. The Hf-W chronology of Nedagolla indicates that this mixed NC-CC isotopic composition was established relatively late, more than 7 million years after Solar System formation. The mixed NC-CC isotopic composition is consistent with the chemical composition of Nedagolla, which combines signatures of metal segregation under more oxidizing conditions (relative depletions in Mo and W), characteristic for CC bodies, and more reducing conditions (high Si and Cr contents), characteristic for some NC bodies, in a single sample. These data combined suggest that Nedagolla formed as the result of collisional mixing of NC and CC core material, which partially re-equilibrated with silicate mantle material that predominantly derives from the NC body. These mixing processes might have occurred during a hit-and-run collision between two differentiated bodies, which also provides a possible pathway for Nedagolla's extreme volatile element depletion. As such, Nedagolla provides the first isotopic evidence for early collisional mixing of NC and CC bodies that is expected as a result of Jupiter's growth.


title: A C\`adl\`ag Rough Path Foundation for Robust Finance

abstract: Using rough path theory, we provide a pathwise foundation for stochastic It\^o integration, which covers most commonly applied trading strategies and mathematical models of financial markets, including those under Knightian uncertainty. To this end, we introduce the so-called Property (RIE) for c\`adl\`ag paths, which is shown to imply the existence of a c\`adl\`ag rough path and of quadratic variation in the sense of F\"ollmer. We prove that the corresponding rough integrals exist as limits of left-point Riemann sums along a suitable sequence of partitions. This allows one to treat integrands of non-gradient type, and gives access to the powerful stability estimates of rough path theory. Additionally, we verify that (path-dependent) functionally generated trading strategies and Cover's universal portfolio are admissible integrands, and that Property (RIE) is satisfied by both (Young) semimartingales and typical price paths.


title: Incentivizing an Unknown Crowd

abstract: Motivated by the common strategic activities in crowdsourcing labeling, we study the problem of sequential eliciting information without verification (EIWV) for workers with a heterogeneous and unknown crowd. We propose a reinforcement learning-based approach that is effective against a wide range of settings including potential irrationality and collusion among workers. With the aid of a costly oracle and the inference method, our approach dynamically decides the oracle calls and gains robustness even under the presence of frequent collusion activities. Extensive experiments show the advantage of our approach. Our results also present the first comprehensive experiments of EIWV on large-scale real datasets and the first thorough study of the effects of environmental variables.


title: Evaluation of imputation techniques with varying percentage of missing data

abstract: Missing data is a common problem which has consistently plagued statisticians and applied analytical researchers. While replacement methods like mean-based or hot deck imputation have been well researched, emerging imputation techniques enabled through improved computational resources have had limited formal assessment. This study formally considers five more recently developed imputation methods: Amelia, Mice, mi, Hmisc and missForest - compares their performances using RMSE against actual values and against the well-established mean-based replacement approach. The RMSE measure was consolidated by method using a ranking approach. Our results indicate that the missForest algorithm performed best and the mi algorithm performed worst.


title: Coordinate Descent Methods for DC Minimization: Optimality Conditions and Global Convergence

abstract: Difference-of-Convex (DC) minimization, referring to the problem of minimizing the difference of two convex functions, has been found rich applications in statistical learning and studied extensively for decades. However, existing methods are primarily based on multi-stage convex relaxation, only leading to weak optimality of critical points. This paper proposes a coordinate descent method for minimizing a class of DC functions based on sequential nonconvex approximation. Our approach iteratively solves a nonconvex one-dimensional subproblem globally, and it is guaranteed to converge to a coordinate-wise stationary point. We prove that this new optimality condition is always stronger than the standard critical point condition and directional point condition under a mild \textit{locally bounded nonconvexity assumption}. For comparisons, we also include a naive variant of coordinate descent methods based on sequential convex approximation in our study. When the objective function satisfies a \textit{globally bounded nonconvexity assumption} and \textit{Luo-Tseng error bound assumption}, coordinate descent methods achieve \textit{Q-linear} convergence rate. Also, for many applications of interest, we show that the nonconvex one-dimensional subproblem can be computed exactly and efficiently using a breakpoint searching method. Finally, we have conducted extensive experiments on several statistical learning tasks to show the superiority of our approach. Keywords: Coordinate Descent, DC Minimization, DC Programming, Difference-of-Convex Programs, Nonconvex Optimization, Sparse Optimization, Binary Optimization.


title: Regularized big bang singularity: Geodesic congruences

abstract: We investigate a particular regularization of big bang singularity, which remains within the domain of 4-dimensional general relativity but allowing for degenerate metrics. We study the geodesics and geodesic congruences in the modified Friedmann-Lema\^itre-Robertson-Walker universe. In particular, we calculate the expansion of timelike and null geodesic congruences. Based on these results, we also briefly discuss the cosmological singularity theorems.


title: A Systematic Approach to Group Fairness in Automated Decision Making

abstract: While the field of algorithmic fairness has brought forth many ways to measure and improve the fairness of machine learning models, these findings are still not widely used in practice. We suspect that one reason for this is that the field of algorithmic fairness came up with a lot of definitions of fairness, which are difficult to navigate. The goal of this paper is to provide data scientists with an accessible introduction to group fairness metrics and to give some insight into the philosophical reasoning for caring about these metrics. We will do this by considering in which sense socio-demographic groups are compared for making a statement on fairness.


title: Green functions in the renormalized many-body perturbation theory

abstract: I review the way the many-body Green functions are used to renormalize the perturbation theory of correlated fermions. The Green functions are introduced to implement systematically dynamical corrections to the static mean-field theory. The renormalizations enter the perturbation theory via self-consistent evaluations of one-particle and two-particle Green functions. The one-particle self-consistency is discussed within the Baym-Kadanoff construction. We point to an inherent dichotomy of the Baym-Kadanoff approach in the relation between one and two-particle Green functions. They are the Schwinger-Dyson equation, directly derived from the generating Luttinger-Ward functional, and the Ward identity. The latter imposes a severe restriction on the two-particle irreducible vertex and is not guaranteed in the Baym-Kadanoff approach. No approximate theory is capable to obey both relations. I further discuss the two-particle approach with two-particle renormalizations that offers a way to reconcile the Schwinger-Dyson equation and the Ward identity. The two-particle irreducible vertex from the critical Bethe-Salpeter equation becomes a generating functional in the two-particle renormalization of the perturbation theory. The irreducible vertex is used in the Ward identity to determine the order parameter beyond the critical point and in the Bethe-Salpeter equation representing the vertex of the Schwinger-Dyson equation to determine the spectral self-energy in such a way that the thermodynamic critical behavior from both equations is qualitatively the same. Finally, I discuss a static mean-field-like approximation with a renormalized effective interaction determined self-consistently that leads to a qualitatively correct description of strong electron correlations in impurity and lattice models.


title: Skyrmion bound state and dynamics in an antiferromagnetic bilayer racetrack

abstract: We investigate the dynamics of two skyrmions lying in distinct layers of an antiferromagnetic bilayer system, consisting of nanostripes with the shape of racetracks. The top and bottom nanostripes are separated by a height offset and they are coupled through a ferromagnetic exchange, allowing the interaction between the skyrmions from both layers. Depending on the distance between the skyrmions they attract each other sufficiently to achieve a bound state. We also analyze their dynamics when an electric current is applied in a unique layer and we determine how the bound-state nucleation depends on the current density and vertical distance between the skyrmions. Finally, we analyzed the robustness of the bound states by considering two situations: 1) a system constituted by clean or homogeneous antiferromagnetic racetracks; 2) a system in which randomly distributed magnetic impurities in both layers are included in the system.


title: A new varifold solution concept for mean curvature flow: Convergence of the Allen-Cahn equation and weak-strong uniqueness

abstract: We propose a new weak solution concept for (two-phase) mean curvature flow which enjoys both (unconditional) existence and (weak-strong) uniqueness properties. These solutions are evolving varifolds, just as in Brakke's formulation, but are coupled to the phase volumes by a simple transport equation. First, we show that, in the exact same setup as in Ilmanen's proof [J. Differential Geom. 38, 417-461, (1993)], any limit point of solutions to the Allen-Cahn equation is a varifold solution in our sense. Second, we prove that any calibrated flow in the sense of Fischer et al. [arXiv:2003.05478] - and hence any classical solution to mean curvature flow - is unique in the class of our new varifold solutions. This is in sharp contrast to the case of Brakke flows, which a priori may disappear at any given time and are therefore fatally non-unique. Finally, we propose an extension of the solution concept to the multi-phase case which is at least guaranteed to satisfy a weak-strong uniqueness principle.


title: On Discrete Truthful Heterogeneous Two-Facility Location

abstract: We revisit the discrete heterogeneous two-facility location problem, in which there is a set of agents that occupy nodes of a line graph, and have private approval preferences over two facilities. When the facilities are located at some nodes of the line, each agent derives a cost that is equal to her total distance from the facilities she approves. The goal is to decide where to locate the two facilities, so as to (a) incentivize the agents to truthfully report their preferences, and (b) achieve a good approximation of the minimum total (social) cost or the maximum cost among all agents. For both objectives, we design deterministic strategyproof mechanisms with approximation ratios that significantly outperform the state-of-the-art, and complement these results with (almost) tight lower bounds.


title: EEGDnet: Fusing Non-Local and Local Self-Similarity for 1-D EEG Signal Denoising with 2-D Transformer

abstract: Electroencephalogram (EEG) has shown a useful approach to produce a brain-computer interface (BCI). One-dimensional (1-D) EEG signal is yet easily disturbed by certain artifacts (a.k.a. noise) due to the high temporal resolution. Thus, it is crucial to remove the noise in received EEG signal. Recently, deep learning-based EEG signal denoising approaches have achieved impressive performance compared with traditional ones. It is well known that the characteristics of self-similarity (including non-local and local ones) of data (e.g., natural images and time-domain signals) are widely leveraged for denoising. However, existing deep learning-based EEG signal denoising methods ignore either the non-local self-similarity (e.g., 1-D convolutional neural network) or local one (e.g., fully connected network and recurrent neural network). To address this issue, we propose a novel 1-D EEG signal denoising network with 2-D transformer, namely EEGDnet. Specifically, we comprehensively take into account the non-local and local self-similarity of EEG signal through the transformer module. By fusing non-local self-similarity in self-attention blocks and local self-similarity in feed forward blocks, the negative impact caused by noises and outliers can be reduced significantly. Extensive experiments show that, compared with other state-of-the-art models, EEGDnet achieves much better performance in terms of both quantitative and qualitative metrics.


title: ECQ$^{\text{x}}$: Explainability-Driven Quantization for Low-Bit and Sparse DNNs

abstract: The remarkable success of deep neural networks (DNNs) in various applications is accompanied by a significant increase in network parameters and arithmetic operations. Such increases in memory and computational demands make deep learning prohibitive for resource-constrained hardware platforms such as mobile devices. Recent efforts aim to reduce these overheads, while preserving model performance as much as possible, and include parameter reduction techniques, parameter quantization, and lossless compression techniques. In this chapter, we develop and describe a novel quantization paradigm for DNNs: Our method leverages concepts of explainable AI (XAI) and concepts of information theory: Instead of assigning weight values based on their distances to the quantization clusters, the assignment function additionally considers weight relevances obtained from Layer-wise Relevance Propagation (LRP) and the information content of the clusters (entropy optimization). The ultimate goal is to preserve the most relevant weights in quantization clusters of highest information content. Experimental results show that this novel Entropy-Constrained and XAI-adjusted Quantization (ECQ$^{\text{x}}$) method generates ultra low-precision (2-5 bit) and simultaneously sparse neural networks while maintaining or even improving model performance. Due to reduced parameter precision and high number of zero-elements, the rendered networks are highly compressible in terms of file size, up to $103\times$ compared to the full-precision unquantized DNN model. Our approach was evaluated on different types of models and datasets (including Google Speech Commands, CIFAR-10 and Pascal VOC) and compared with previous work.


title: Study of entanglement via a multi-agent dynamical quantum game

abstract: At both conceptual and applied levels, quantum physics provides new opportunities as well as fundamental limitations. We hypothetically ask whether quantum games inspired by population dynamics can benefit from unique features of quantum mechanics such as entanglement and nonlocality. For doing so we extend quantum game theory and demonstrate that in certain models mimicking ecological systems where several predators feed on the same prey, the strength of quantum entanglement between the various species has a profound effect on the asymptotic behavior of the system. For example, if there are sufficiently many predator species who are all equally correlated with their prey, they are all driven to extinction. Our results are derived in two ways: by analyzing the asymptotic dynamics of the system, and also by modeling the system as a quantum correlation network. The latter approach enables us to apply various tools from classical network theory in the above quantum scenarios. Several generalizations and applications are discussed.


title: Gravitational memory effects in Chern-Simons modified gravity

abstract: The gravitational memory effects of Chern-Simons modified gravity are considered in the asymptotically flat spacetime. If the Chern-Simons scalar does not directly couple with the ordinary matter fields, there are also displacement, spin and center-of-mass memory effects as in general relativity. This is because the term of the action that violates the parity invariance is linear in the scalar field but quadratic in the curvature tensor. This results in the parity violation occuring at the higher orders in the inverse luminosity radius. The scalar field does not induce any new memory effects that can be detected by interferometers or pulsar timing arrays. The asymptotic symmetry is group is also the extended Bondi-Metzner-Sachs group. The constraints on the memory effects excited by the tensor modes are obtained.


title: From the Sigma-type to the Grothendieck construction

abstract: We translate properties of the Sigma-type in Martin-L\"of Type Theory (MLTT) to properties of the Grothendieck construction in category theory. Namely, equivalences in MLTT that involve the Sigma-type motivate isomorphisms between corresponding categories that involve the Grothendieck construction. The type-theoretic axiom of choice and the "associativity" of the Sigma-type are the main examples of this phenomenon that are treated here.


title: MetaXT: Meta Cross-Task Transfer between Disparate Label Spaces

abstract: Albeit the universal representational power of pre-trained language models, adapting them onto a specific NLP task still requires a considerably large amount of labeled data. Effective task fine-tuning meets challenges when only a few labeled examples are present for the task. In this paper, we aim to the address of the problem of few shot task learning by exploiting and transferring from a different task which admits a related but disparate label space. Specifically, we devise a label transfer network (LTN) to transform the labels from source task to the target task of interest for training. Both the LTN and the model for task prediction are learned via a bi-level optimization framework, which we term as MetaXT. MetaXT offers a principled solution to best adapt a pre-trained language model to the target task by transferring knowledge from the source task. Empirical evaluations on cross-task transfer settings for four NLP tasks, from two different types of label space disparities, demonstrate the effectiveness of MetaXT, especially when the labeled data in the target task is limited.


title: Robust single- and multi-loudspeaker least-squares-based equalization for hearing devices

abstract: To improve the sound quality of hearing devices, equalization filters can be used that aim at achieving acoustic transparency, i.e., listening with the device in the ear is perceptually similar to the open ear. The equalization filter needs to ensure that the superposition of the equalized signal played by the device and the signal leaking through the device into the ear canal matches a processed version of the signal reaching the eardrum of the open ear. Depending on the processing delay of the hearing device, comb-filtering artifacts can occur due to this superposition, which may degrade the perceived sound quality. In this paper we propose a unified least-squares-based procedure to design single- and multi-loudspeaker equalization filters for hearing devices aiming at achieving acoustic transparency. To account for non-minimum phase components, we introduce a so-called acausality management. To reduce comb-filtering artifacts, we propose to use a frequency-dependent regularization. Experimental results using measured acoustic transfer functions from a multi-loudspeaker earpiece show that the proposed equalization filter design procedure enables to achieve robust acoustic transparency and reduces the impact of comb-filtering artifacts. A comparison between single- and multi-loudspeaker equalization shows that for both cases a robust equalization performance can be achieved for different desired open ear transfer functions.


title: IICNet: A Generic Framework for Reversible Image Conversion

abstract: Reversible image conversion (RIC) aims to build a reversible transformation between specific visual content (e.g., short videos) and an embedding image, where the original content can be restored from the embedding when necessary. This work develops Invertible Image Conversion Net (IICNet) as a generic solution to various RIC tasks due to its strong capacity and task-independent design. Unlike previous encoder-decoder based methods, IICNet maintains a highly invertible structure based on invertible neural networks (INNs) to better preserve the information during conversion. We use a relation module and a channel squeeze layer to improve the INN nonlinearity to extract cross-image relations and the network flexibility, respectively. Experimental results demonstrate that IICNet outperforms the specifically-designed methods on existing RIC tasks and can generalize well to various newly-explored tasks. With our generic IICNet, we no longer need to hand-engineer task-specific embedding networks for rapidly occurring visual content. Our source codes are available at: https://github.com/felixcheng97/IICNet.


title: Understanding Cycling Mobility: Bologna Case Study

abstract: Understanding human mobility in urban environments is of the utmost importance to manage traffic and for deploying new resources and services. In recent years, the problem is exacerbated due to rapid urbanization and climate changes. In an urban context, human mobility has many facets, and cycling represents one of the most eco-friendly and efficient/effective ways to move in touristic and historical cities. The main objective of this work is to study the cycling mobility within the city of Bologna, Italy. We used six months dataset that consists of 320,118 self-reported bike trips. In particular, we performed several descriptive analysis to understand spatial and temporal patterns of bike users for understanding popular roads, and most favorite points within the city. This analysis involved several other public datasets in order to explore variables that can possibly affect the cycling activity, such as weather, pollution, and events. The main results of this study indicate that bike usage is more correlated to temperature, and precipitation and has no correlation to wind speed and pollution. In addition, we also exploited various machine learning and deep learning approaches for predicting short-term trips in the near future (that is for the following 30, and 60 minutes), that could help local governmental agencies for urban planning. Our best model achieved an R square of 0.91, a Mean Absolute Error of 5.38 and a Root Mean Squared Error of 8.12 for the 30-minutes time interval.


title: Supervised Linear Dimension-Reduction Methods: Review, Extensions, and Comparisons

abstract: Principal component analysis (PCA) is a well-known linear dimension-reduction method that has been widely used in data analysis and modeling. It is an unsupervised learning technique that identifies a suitable linear subspace for the input variable that contains maximal variation and preserves as much information as possible. PCA has also been used in prediction models where the original, high-dimensional space of predictors is reduced to a smaller, more manageable, set before conducting regression analysis. However, this approach does not incorporate information in the response during the dimension-reduction stage and hence can have poor predictive performance. To address this concern, several supervised linear dimension-reduction techniques have been proposed in the literature. This paper reviews selected techniques, extends some of them, and compares their performance through simulations. Two of these techniques, partial least squares (PLS) and least-squares PCA (LSPCA), consistently outperform the others in this study.


title: A strong convergence theorem for solving an equilibrium problem and a fixed point problem using the Bregman distance

abstract: In this paper, using the Bregman distance, we introduce a new projection-type algorithm for finding a common element of the set of solutions of an equilibrium problem and the set of fixed points. Then the strong convergence of the sequence generated by the algorithm will be established under suitable conditions. Finally, using MATLAB software, we present a numerical example to illustrate the convergence performance of our algorithm.


title: Entropy of induced maps of regular curves homeomorphisms

abstract: Let $f:X\to X$ be a self homeomorphism of a continuum $X$, we show that the topological entropy of the induced system $(2^X,2^f)$ is infinite provided that $X\setminus \Omega(f)$ is not empty. If furthermore $X$ is a regular curve then it is shown that $(2^X,2^f)$ has infinite topological entropy if and only if $X\setminus \Omega(f)$ is not empty. Moreover we prove for the induced system $(C(X),C(f))$ the equivalence between the following properties: (i) zero topological entropy; (ii) there is no Li-Yorke pair and (iii) for any periodic subcontinnum $A$ of $X$ and any connected component $C$ of $X\setminus \Omega(f)$, $C\subset A$ if $A\cap C\neq \emptyset$. In particular, the topological entropy of either $(2^X,2^f)$ or $(C(X),C(f))$ has only two possible values $0$ or $\infty$. At the end, we give an example of a pointwise periodic rational curve homeomorphism $F:Y\to Y$ with infinite topological entropy induced map $C(F)$.


title: DAE : Discriminatory Auto-Encoder for multivariate time-series anomaly detection in air transportation

abstract: The Automatic Dependent Surveillance Broadcast protocol is one of the latest compulsory advances in air surveillance. While it supports the tracking of the ever-growing number of aircraft in the air, it also introduces cybersecurity issues that must be mitigated e.g., false data injection attacks where an attacker emits fake surveillance information. The recent data sources and tools available to obtain flight tracking records allow the researchers to create datasets and develop Machine Learning models capable of detecting such anomalies in En-Route trajectories. In this context, we propose a novel multivariate anomaly detection model called Discriminatory Auto-Encoder (DAE). It uses the baseline of a regular LSTM-based auto-encoder but with several decoders, each getting data of a specific flight phase (e.g. climbing, cruising or descending) during its training.To illustrate the DAE's efficiency, an evaluation dataset was created using real-life anomalies as well as realistically crafted ones, with which the DAE as well as three anomaly detection models from the literature were evaluated. Results show that the DAE achieves better results in both accuracy and speed of detection. The dataset, the models implementations and the evaluation results are available in an online repository, thereby enabling replicability and facilitating future experiments.


title: Improving quantum linear system solvers via a gradient descent perspective

abstract: Solving systems of linear equations is one of the most important primitives in quantum computing that has the potential to provide a practical quantum advantage in many different areas, including in optimization, simulation, and machine learning. In this work, we revisit quantum linear system solvers from the perspective of convex optimization, and in particular gradient descent-type algorithms. This leads to a considerable constant-factor improvement in the runtime (or, conversely, a several orders of magnitude smaller error with the same runtime/circuit depth). More precisely, we first show how the asymptotically optimal quantum linear system solver of Childs, Kothari, and Somma is related to the gradient descent algorithm on the convex function $\|A\vec x - \vec b\|_2^2$: their linear system solver is based on a truncation in the Chebyshev basis of the degree-$(t-1)$ polynomial (in $A$) that maps the initial solution $\vec{x}_1 := \vec{b}$ to the $t$-th iterate $\vec{x}_t$ in the basic gradient descent algorithm. Then, instead of starting from the basic gradient descent algorithm, we use the optimal Chebyshev iteration method (which can be viewed as an accelerated gradient descent algorithm) and show that this leads to considerable improvements in the quantum solver.


title: Intense-pulse dynamics of massless Dirac electrons

abstract: We identify and describe how intense short light pulses couple to massless Dirac fermions in two-dimensional systems. The ensuing excitation dynamics exhibits unusual scaling with the wavelength of the light due the linear dispersion of the band structure and the fact that light coupling is efficient only close to the Dirac points. We exploit these features to achieve valley polarization of more than 70 % with simple pulse shapes. Quantitative results are given for pristine graphene.


title: High-fidelity reconstruction of turbulent flow from spatially limited data using enhanced super-resolution generative adversarial network

abstract: In this study, a deep learning-based approach is applied with the aim of reconstructing high-resolution turbulent flow fields using minimal flow fields data. A multi-scale enhanced super-resolution generative adversarial network with a physics-based loss function is introduced as a model to reconstruct the high-resolution flow fields. The model capability to reconstruct high-resolution laminar flows is examined using data of laminar flow around a square cylinder. The results reveal that the model can accurately reproduce the high-resolution flow fields even when limited spatial information is provided. The case of turbulent channel flow is used to assess the ability of the model to reconstruct the high-resolution wall-bounded turbulent flow fields. The instantaneous and statistical results obtained from the model agree well with the ground truth data, indicating that the model can successfully learn to map the coarse flow fields to the high-resolution once. Furthermore, the computational cost of the proposed model, which is examined carefully, is found to be effectively low. This demonstrates that using high-fidelity training data with physics-guided generative adversarial network-based models can be practically efficient in reconstructing high-resolution turbulent flow fields from extremely coarse data.


title: On the average character degree of some irreducible characters of a finite group

abstract: Let G be a finite group and N be a non-trivial normal subgroup of G, such that the average character degree of irreducible characters in Irr(G|N) is less than or equal to 16=5. Then we prove that N is solvable. Also, we prove the solvability of G, by assuming that the average character degree of irreducible characters in Irr(G|N) is strictly less than 16=5. We show that the bounds are sharp.


title: Semiregularity and connectivity of the non-$\mathfrak F$ graph of a finite group

abstract: Given a class $\mathfrak F$ of finite groups, we consider the graph $\widetilde\Gamma_{\mathfrak F}(G)$ whose vertices are the elements of $G$ and where two vertices $g,h\in G$ are adjacent if and only if $\langle g,h\rangle\notin\mathfrak F$. Moreover we denote by $\mathcal{I}_{\mathfrak F}(G)$ the set of the isolated vertices of $\widetilde\Gamma_{\mathfrak F}(G).$ We address the following question: to what extent the fact that $\mathcal{I}_{\mathfrak F}(G)$ is a subgroup of $H$ for any $H\leq G,$ implies that the graph $\Gamma_{\mathfrak F}G)$ obtained from $\widetilde\Gamma_{\mathfrak F}(G)$ by deleting the isolated vertices is a connected graph?


title: Dubhe: Towards Data Unbiasedness with Homomorphic Encryption in Federated Learning Client Selection

abstract: Federated learning (FL) is a distributed machine learning paradigm that allows clients to collaboratively train a model over their own local data. FL promises the privacy of clients and its security can be strengthened by cryptographic methods such as additively homomorphic encryption (HE). However, the efficiency of FL could seriously suffer from the statistical heterogeneity in both the data distribution discrepancy among clients and the global distribution skewness. We mathematically demonstrate the cause of performance degradation in FL and examine the performance of FL over various datasets. To tackle the statistical heterogeneity problem, we propose a pluggable system-level client selection method named Dubhe, which allows clients to proactively participate in training, meanwhile preserving their privacy with the assistance of HE. Experimental results show that Dubhe is comparable with the optimal greedy method on the classification accuracy, with negligible encryption and communication overhead.


title: Wavelength Calibration and Resolving Power of the JWST MIRI Medium Resolution Spectrometer

abstract: The Mid-Infrared Instrument (MIRI) on-board JWST will provide imaging, coronagraphy, low-resolution spectroscopy and medium-resolution spectroscopy at unprecedented sensitivity levels in the mid-infrared wavelength range. The Medium-Resolution Spectrometer (MRS) of MIRI is an integral field spectrograph that provides diffraction-limited spectroscopy between 4.9 and 28.3 um, within a FOV varying from 13 to 56" square. From ground testing, we calculate the physical parameters essential to general observers and calibrating the wavelength solution and resolving power of the MRS is critical for maximising the scientific performance of the instrument. We have used ground-based observations of discrete spectral features in combination with Fabry-Perot etalon spectra to characterize the wavelength solution and spectral resolving power of the MRS. We present the methodology used to derive the MRS spectral characterisation, which includes the precise wavelength coverage of each MRS sub-band, computation of the resolving power as a function of wavelength, and measuring slice-dependent spectral distortions. The resolving power varies from R3500 in channel 1 to R1500 in channel 4. Based on the ground test data, the wavelength calibration accuracy is estimated to be below one tenth of a pixel, with small systematic shifts due to the target position within a slice for unresolved sources, that have a maximum amplitude of about 0.25 spectral resolution elements. Based on ground test data, the MRS complies with the spectral requirements for both the R and wavelength accuracy for which it was designed. We also present the commissioning strategies and targets that will be followed to update the spectral characterisation of the MRS.

categories: astro-ph.IM astro-ph.EP astro-ph.GA astro-ph.SR


title: Optimal Reservoir Operations using Long Short-Term Memory Network

abstract: A reliable forecast of inflows to the reservoir is a key factor in the optimal operation of reservoirs. Real-time operation of the reservoir based on forecasts of inflows can lead to substantial economic gains. However, the forecast of inflow is an intricate task as it has to incorporate the impacts of climate and hydrological changes. Therefore, the major objective of the present work is to develop a novel approach based on long short-term memory (LSTM) for the forecast of inflows. Real-time inflow forecast, in other words, daily inflow at the reservoir helps in efficient operation of water resources. Also, daily variations in the release can be monitored efficiently and the reliability of operation is improved. This work proposes a naive anomaly detection algorithm baseline based on LSTM. In other words, a strong baseline to forecast flood and drought for any deep learning-based prediction model. The practicality of the approach has been demonstrated using the observed daily data of the past 20 years from Bhakra Dam in India. The results of the simulations conducted herein clearly indicate the supremacy of the LSTM approach over the traditional methods of forecasting. Although, experiments are run on data from Bhakra Dam Reservoir in India, LSTM model, and anomaly detection algorithm are general purpose and can be applied to any basin with minimal changes. A distinct practical advantage of the LSTM method presented herein is that it can adequately simulate non-stationarity and non-linearity in the historical data.


title: Cataloging Dependency Injection Anti-Patterns in Software Systems

abstract: Context: Dependency Injection (DI) is a commonly applied mechanism to decouple classes from their dependencies in order to provide higher modularization. However, bad DI practices often lead to negative consequences, such as increasing coupling. Although white literature conjectures about the existence of DI anti-patterns, there is no evidence on their practical relevance, usefulness, and generality. Objective: The objective of this study is to propose and evaluate a catalog of Java DI anti-patterns and associated refactorings. Methodology: We reviewed existing reported DI anti-patterns in order to analyze their completeness. The limitations found in literature motivated proposing a novel catalog of 12 DI anti-patterns. We developed a tool to statically analyze the occurrence level of the candidate DI anti-patterns in both open-source and industry projects. Next, we survey practitioners to assess their perception on the relevance, usefulness, and their willingness on refactoring anti-pattern instances of the catalog. Results: Our static code analyzer tool showed a relative recall of 92.19% and high average precision. It revealed that at least 9 different DI anti-patterns appeared frequently in the analyzed projects. Besides, our survey confirmed the perceived relevance of the catalog and developers expressed their willingness to refactor instances of anti-patterns from source code. Conclusion: The catalog contains Java DI anti-patterns that occur in practice and that are perceived as useful. Sharing it with practitioners may help them to avoid such anti-patterns, thus improving source-code quality.


title: GNisi: A graph network for reconstructing Ising models from multivariate binarized data

abstract: Ising models are a simple generative approach to describing interacting binary variables. They have proven useful in a number of biological settings because they enable one to represent observed many-body correlations as the separable consequence of many direct, pairwise statistical interactions. The inference of Ising models from data can be computationally very challenging and often one must be satisfied with numerical approximations or limited precision. In this paper we present a novel method for the determination of Ising parameters from data, called GNisi, which uses a Graph Neural network trained on known Ising models in order to construct the parameters for unseen data. We show that GNisi is more accurate than the existing state of the art software, and we illustrate our method by applying GNisi to gene expression data.


title: A Derivative-based Parser Generator for Visibly Pushdown Grammars

abstract: In this paper, we present a derivative-based, functional recognizer and parser generator for visibly pushdown grammars. The generated parser accepts ambiguous grammars and produces a parse forest containing all valid parse trees for an input string in linear time. Each parse tree in the forest can then be extracted also in linear time. Besides the parser generator, to allow more flexible forms of the visibly pushdown grammars, we also present a translator that converts a tagged CFG to a visibly pushdown grammar in a sound way, and the parse trees of the tagged CFG are further produced by running the semantic actions embedded in the parse trees of the translated visibly pushdown grammar. The performance of the parser is compared with a popular parsing tool ANTLR and other popular hand-crafted parsers. The correctness of the core parsing algorithm is formally verified in the proof assistant Coq.


title: Arboreal Topological and Fracton Phases

abstract: We describe topologically ordered and fracton ordered states on novel geometries which do not have an underlying manifold structure. Using tree graphs such as the $k$-coordinated Bethe lattice ${\cal B}(k)$ and a hypertree called the $(k,n)$-hyper-Bethe lattice ${\cal HB}(k,n)$ consisting of $k$-coordinated hyperlinks (defined by $n$ sites), we construct multidimensional arboreal arenas such as ${\cal B}(k_1) \square {\cal B}(k_2)$ by the notion of a graph Cartesian product $\square$. We study various quantum systems such as the ${\mathbb Z}_2$ gauge theory, generalized quantum Ising models (GQIM), the fractonic X-cube model, and related X-cube gauge theory defined on these arenas. Even the simplest ${\mathbb Z}_2$ gauge theory on a 2d arboreal arena is fractonic -- the monopole excitation is immobile. The X-cube model on a 3d arboreal arena is fully fractonic, all multipoles are rendered immobile. We obtain variational ground state phase diagrams of these gauge theories. Further, we find an intriguing class of dualities in arboreal arenas as illustrated by the ${\mathbb Z}_2$ gauge theory defined on ${\cal B}(k_1) \square {\cal B}(k_2)$ being dual to a GQIM defined on ${\cal HB}(2,k_1) \square {\cal HB}(2,k_2)$. Finally, we discuss different classes of topological and fracton orders on arboreal arenas. We find three distinct classes of arboreal toric code orders on 2d arboreal arenas, those that occur on ${\cal B}(2) \square {\cal B}(2)$, ${\cal B}(k) \square {\cal B}(2), k >2$, and ${\cal B}(k_1) \square {\cal B}(k_2)$, $k_1,k_2>2$. Likewise, four classes of X-cube fracton orders are found in 3d arboreal arenas -- those on ${\cal B}(2)\square{\cal B}(2)\square {\cal B}(2)$, ${\cal B}(k) \square {\cal B}(2)\square {\cal B}(2), k>2$, ${\cal B}(k_1) \square {\cal B}(k_2) \square {\cal B}(2), k_1,k_2 >2$, and ${\cal B}(k_1) \square {\cal B}(k_2) \square {\cal B}(k_3), k_1,k_2,k_3 >2$.


title: Online Enhanced Semantic Hashing: Towards Effective and Efficient Retrieval for Streaming Multi-Modal Data

abstract: With the vigorous development of multimedia equipment and applications, efficient retrieval of large-scale multi-modal data has become a trendy research topic. Thereinto, hashing has become a prevalent choice due to its retrieval efficiency and low storage cost. Although multi-modal hashing has drawn lots of attention in recent years, there still remain some problems. The first point is that existing methods are mainly designed in batch mode and not able to efficiently handle streaming multi-modal data. The second point is that all existing online multi-modal hashing methods fail to effectively handle unseen new classes which come continuously with streaming data chunks. In this paper, we propose a new model, termed Online enhAnced SemantIc haShing (OASIS). We design novel semantic-enhanced representation for data, which could help handle the new coming classes, and thereby construct the enhanced semantic objective function. An efficient and effective discrete online optimization algorithm is further proposed for OASIS. Extensive experiments show that our method can exceed the state-of-the-art models. For good reproducibility and benefiting the community, our code and data are already available in supplementary material and will be made publicly available.


title: Learning cortical representations through perturbed and adversarial dreaming

abstract: Humans and other animals learn to extract general concepts from sensory experience without extensive teaching. This ability is thought to be facilitated by offline states like sleep where previous experiences are systemically replayed. However, the characteristic creative nature of dreams suggests that learning semantic representations may go beyond merely replaying previous experiences. We support this hypothesis by implementing a cortical architecture inspired by generative adversarial networks (GANs). Learning in our model is organized across three different global brain states mimicking wakefulness, NREM and REM sleep, optimizing different, but complementary objective functions. We train the model on standard datasets of natural images and evaluate the quality of the learned representations. Our results suggest that generating new, virtual sensory inputs via adversarial dreaming during REM sleep is essential for extracting semantic concepts, while replaying episodic memories via perturbed dreaming during NREM sleep improves the robustness of latent representations. The model provides a new computational perspective on sleep states, memory replay and dreams and suggests a cortical implementation of GANs.


title: Frobenius Finds Non-monogenic Division Fields of Abelian Varieties

abstract: Let $A$ be an abelian variety over a finite field $k$ with $|k|=q=p^m$. Let $\pi\in \text{End}_k(A)$ denote the Frobenius and let $v=\frac{q}{\pi}$ denote Verschiebung. Suppose the Weil $q$-polynomial of $A$ is irreducible. When $\text{End}_k(A)=\mathbb{Z}[\pi,v]$, we construct a matrix which describes the action of $\pi$ on the prime-to-$p$-torsion points of $A$. We employ this matrix in an algorithm that detects when $p$ is an obstruction to the monogeneity of division fields of certain abelian varieties.


title: Complex chiral columns made of achiral quinoxaline derivatives with semi-flexible cores

abstract: Mesogenic materials, quinoxaline derivatives with semi-flexible cores, are reported to form new type of 3D columnar structure with large crystallographic unit cell and Fddd symmetry below columnar hexagonal phase. The 3D columnar structure is a result of frustration imposed by arrangement of helical columns of opposite chirality into triangular lattice. The studied materials exhibit fluorescent properties that could be easily tuned by modification of molecular structure, compounds with the extended {\pi} electron conjugated systems form aggregates and fluorescence is quenched. For molecules with flexible structure the fluorescence quantum yield reaches 25%. On the other hand, compounds with more rigid mesogenic core, for which fluorescence is suppressed show strong hole photocurrent. For some materials also bi-polar: hole and electron transfer was observed.


title: Solving Simultaneous Target Assignment and Path Planning Efficiently with Time-Independent Execution

abstract: Real-time planning for a combined problem of target assignment and path planning for multiple agents, also known as the unlabeled version of Multi-Agent Path Finding (MAPF), is crucial for high-level coordination in multi-agent systems, e.g., pattern formation by robot swarms. This paper studies two aspects of unlabeled-MAPF: (1) offline scenario: solving large instances by centralized approaches with small computation time, and (2) online scenario: executing unlabeled-MAPF despite timing uncertainties of real robots. For this purpose, we propose TSWAP, a novel sub-optimal complete algorithm, which takes an arbitrary initial target assignment then repeats one-timestep path planning with target swapping. TSWAP can adapt to both offline and online scenarios. We empirically demonstrate that Offline TSWAP is highly scalable; providing near-optimal solutions while reducing runtime by orders of magnitude compared to existing approaches. In addition, we present the benefits of Online TSWAP, such as delay tolerance, through real-robot demos.


title: Almost sure convergence of the accelerated weight histogram algorithm

abstract: The accelerated weight histogram (AWH) algorithm is an iterative extended ensemble algorithm, developed for statistical physics and computational biology applications. It is used to estimate free energy differences and expectations with respect to Gibbs measures. The AWH algorithm is based on iterative updates of a design parameter, which is closely related to the free energy, obtained by matching a weight histogram with a specified target distribution. The weight histogram is constructed from samples of a Markov chain on the product of the state space and parameter space. In this paper almost sure convergence of the AWH algorithm is proved, for estimating free energy differences as well as estimating expectations with adaptive ergodic averages. The proof is based on identifying the AWH algorithm as a stochastic approximation and studying the properties of the associated limit ordinary differential equation.


title: An objective function for order preserving hierarchical clustering

abstract: We present an objective function for similarity based hierarchical clustering of partially ordered data that preserves the partial order. That is, if $x \le y$, and if $[x]$ and $[y]$ are the respective clusters of $x$ and $y$, then there is an order relation $\le'$ on the clusters for which $[x] \le' |y]$. The theory distinguishes itself from existing theories for clustering of ordered data in that the order relation and the similarity are combined into a bi-objective optimisation problem to obtain a hierarchical clustering seeking to satisfy both. In particular, the order relation is weighted in the range $[0,1]$, and if the similarity and the order relation are not aligned, then order preservation may have to yield in favor of clustering. Finding an optimal solution is NP-hard, so we provide a polynomial time approximation algorithm, with a relative performance guarantee of $O\!\left(\log^{3/2} \!\!\, n \right)$, based on successive applications of directed sparsest cut. We provide a demonstration on a benchmark dataset, showing that our method outperforms existing methods for order preserving hierarchical clustering with significant margin. The theory is an extension of the Dasgupta cost function for divisive hierarchical clustering.


title: Realizations of the formal double Eisenstein space

abstract: We introduce the formal double Eisenstein space $\mathcal{E}_k$, which is a generalization of the formal double zeta space $\mathcal{D}_k$ of Gangl-Kaneko-Zagier, and prove analogues of the sum formula and parity result for formal double Eisenstein series. We show that $\mathbb Q$-linear maps $\mathcal{E}_k\rightarrow A$, for some $\mathbb Q$-algebra $A$, can be constructed from formal Laurent series (with coefficients in $A$) that satisfy the Fay identity. As the prototypical example, we define the Kronecker realization $\rho^{\mathfrak{K}}: \mathcal{E}_k\rightarrow \mathbb Q[[q]]$, which lifts Gangl-Kaneko-Zagier's Bernoulli realization $\rho^B: \mathcal{D}_k\rightarrow \mathbb Q$, and whose image consists of quasimodular forms for the full modular group. As an application to the theory of modular forms, we obtain a purely combinatorial proof of Ramanujan's differential equations for classical Eisenstein series.


title: Spatial Correlation Analysis of Traffic Flow on Parallel Motorways in Germany

abstract: With the widely used method of correlation matrix analysis, this study reveals the change of traffic states on parallel motorways in North Rhine-Westphalia, Germany. In terms of the time series of traffic flow and velocity, we carry out a quantitative analysis in correlations and reveal a high level of strongly positive traffic flow correlation and rich structural features in the corresponding correlation matrices. The strong correlation is mainly ascribed to the daily time evolution of traffic flow during the periods of rush hours and non-rush hours. In terms of free flow and congestion, the structural features are able to capture the average traffic situation we derive from our data. Furthermore, the structural features in correlation matrices for individual time periods corroborate our results from the correlation matrices regarding a whole day. The average correlations in traffic flows and velocities over all pairwise sections disclose the traffic behavior during each individual time period. Our contribution uncovers the potential application of correlation analysis on the study of traffic networks as a complex system.


title: Asynchronous Federated Learning on Heterogeneous Devices: A Survey

abstract: Federated learning (FL) is a kind of distributed machine learning framework, where the global model is generated on the centralized aggregation server based on the parameters of local models, addressing concerns about privacy leakage caused by the collection of local training data. With the growing computational and communication capacities of edge and IoT devices, applying FL on heterogeneous devices to train machine learning models is becoming a prevailing trend. Nonetheless, the synchronous aggregation strategy in the classic FL paradigm, particularly on heterogeneous devices, encounters limitations in resource utilization due to the need to wait for slow devices before aggregation in each training round. Furthermore, the uneven distribution of data across devices (i.e. data heterogeneity) in real-world scenarios adversely impacts the accuracy of the global model. Consequently, many asynchronous FL (AFL) approaches have been introduced across various application contexts to enhance efficiency, performance, privacy, and security. This survey comprehensively analyzes and summarizes existing AFL variations using a novel classification scheme, including device heterogeneity, data heterogeneity, privacy, and security on heterogeneous devices, as well as applications on heterogeneous devices. Finally, this survey reveals rising challenges and presents potentially promising research directions in this under-investigated domain.


title: Toward a Perspectivist Turn in Ground Truthing for Predictive Computing

abstract: Most Artificial Intelligence applications are based on supervised machine learning (ML), which ultimately grounds on manually annotated data. The annotation process is often performed in terms of a majority vote and this has been proved to be often problematic, as highlighted by recent studies on the evaluation of ML models. In this article we describe and advocate for a different paradigm, which we call data perspectivism, which moves away from traditional gold standard datasets, towards the adoption of methods that integrate the opinions and perspectives of the human subjects involved in the knowledge representation step of ML processes. Drawing on previous works which inspired our proposal we describe the potential of our proposal for not only the more subjective tasks (e.g. those related to human language) but also to tasks commonly understood as objective (e.g. medical decision making), and present the main advantages of adopting a perspectivist stance in ML, as well as possible disadvantages, and various ways in which such a stance can be implemented in practice. Finally, we share a set of recommendations and outline a research agenda to advance the perspectivist stance in ML.


title: Stress concentration factors for the Lam\'e system arising from composites

abstract: For two neighbouring stiff inclusions, the stress, which is the gradient of a solution to the Lam\'{e} system of linear elasticity, may exhibit singular behavior as the distance between these two inclusions becomes arbitrarily small. In this paper, a family of stress concentration factors, which determine whether the stress will blow up or not, are accurately constructed in the presence of the generalized $m$-convex inclusions in all dimensions. We then use these stress concentration factors to establish the optimal upper and lower bounds on the stress blow-up rates in any dimension and meanwhile give a precise asymptotic expression of the stress concentration for interfacial boundaries of inclusions with different principal curvatures in dimension three. Finally, the corresponding results for the perfect conductivity problem are also presented.


title: The two-dimensional $t$-$t^{\prime}$ Holstein model

abstract: The competition and interplay between charge-density wave and superconductivity have become a central subject for quasi-2D compounds. Some of these materials, such as the transition-metal dichalcogenides, exhibit strong electron-phonon coupling, an interaction that may favor both phases, depending on the external parameters, such as hydrostatic pressure. In view of this, here we analyze the single-band $t$-$t^{\prime}$ Holstein model in the square lattice, adding a next-nearest neighbor hopping $t^{\prime}$ in order to play the role of the external pressure. To this end, we perform unbiased quantum Monte Carlo simulations with an efficient inversion sampling technique appropriately devised for this model. Such a methodology drastically reduces the autocorrelation time, and increases the efficiency of the Monte Carlo approach. By investigating the charge-charge correlation functions, we obtain the behavior of the critical temperature as a function of $t^{\prime}$, and from compressibility analysis, we show that a first-order metal-to-insulator phase transition occurs. We also provide a low-temperature phase diagram for the model.


title: Measuring the baryonic Tully-Fisher relation below the detection threshold

abstract: We present a novel 2D flux density model for observed HI emission lines combined with a Bayesian stacking technique to measure the baryonic Tully-Fisher relation below the nominal detection threshold. We simulate a galaxy catalogue, which includes HI lines described either with Gaussian or busy function profiles, and HI data cubes with a range of noise and survey areas similar to the MeerKAT International Giga-Hertz Tiered Extragalactic Exploration (MIGHTEE) survey. With prior knowledge of redshifts, stellar masses and inclinations of spiral galaxies, we find that our model can reconstruct the input baryonic Tully-Fisher parameters (slope and zero point) most accurately in a relatively broad redshift range from the local Universe to $z = 0.3$ for all the considered levels of noise and survey areas, and up to $z = 0.55$ for a nominal noise of $90\,\mu$Jy/channel over 5 deg$^{2}$. Our model can also determine the $M_{\rm HI} - M_{\star}$ relation for spiral galaxies beyond the local Universe, and account for the detailed shape of the HI emission line, which is crucial for understanding the dynamics of spiral galaxies. Thus, we have developed a Bayesian stacking technique for measuring the baryonic Tully-Fisher relation for galaxies at low stellar and/or HI masses and/or those at high redshift, where the direct detection of HI requires prohibitive exposure times.


title: Efficient broadband THz generation in BNA organic crystal at Ytterbium laser wavelength

abstract: In this work, we demonstrate BNAs high potential for efficient generation of high power THz using ytterbium laser wavelengths. We study the generation theoretically and experimentally using laser wavelength of 960-1150 nm. Broadband pulses of 0-7 THz and high efficiency of 0.6% are demonstrated.


title: M5Product: Self-harmonized Contrastive Learning for E-commercial Multi-modal Pretraining

abstract: Despite the potential of multi-modal pre-training to learn highly discriminative feature representations from complementary data modalities, current progress is being slowed by the lack of large-scale modality-diverse datasets. By leveraging the natural suitability of E-commerce, where different modalities capture complementary semantic information, we contribute a large-scale multi-modal pre-training dataset M5Product. The dataset comprises 5 modalities (image, text, table, video, and audio), covers over 6,000 categories and 5,000 attributes, and is 500 larger than the largest publicly available dataset with a similar number of modalities. Furthermore, M5Product contains incomplete modality pairs and noise while also having a long-tailed distribution, resembling most real-world problems. We further propose Self-harmonized ContrAstive LEarning (SCALE), a novel pretraining framework that integrates the different modalities into a unified model through an adaptive feature fusion mechanism, where the importance of each modality is learned directly from the modality embeddings and impacts the inter-modality contrastive learning and masked tasks within a multi-modal transformer model. We evaluate the current multi-modal pre-training state-of-the-art approaches and benchmark their ability to learn from unlabeled data when faced with the large number of modalities in the M5Product dataset. We conduct extensive experiments on four downstream tasks and demonstrate the superiority of our SCALE model, providing insights into the importance of dataset scale and diversity.


title: Light dark bosons in the JUNO-TAO neutrino detector

abstract: This work presents a sensitivity study of a reactor liquid scintillator detector to three kinds of dark bosons with masses below 1 MeV, such as dark photons, axion-like particles and light scalar bosons. The JUNO-TAO detector with Taishan nuclear reactor is taken as a reference. With proposed 180 days data taking, the sensitivity to the dark bosons can reach $\sim10^{-5}$ 95%C.L. for the optimized signal to background ratio for the electron coupling constant $\it{g_X} $ through inverse Compton-like scattering. Similar calculations are completed for axion-like particles and scalar bosons. The background systematic uncertainty presents as the main limiting factor for the further sensitivity improvement. Several remarks are made to the controversial analysis for the NEOS experiment. Additionally the differential and the inverse differential cross sections have been derived for all three boson types and their interactions with electrons in liquid scintillator.


title: Phase diagram of the 2+1-dimensional Gross-Neveu model with chiral imbalance

abstract: In this work, the phase diagram of the $2+1$-dimensional Gross-Neveu model is investigated with baryon chemical potential as well as chiral chemical potential in the mean-field approximation. We study the theory using two lattice discretizations, which are both based on naive fermions. An inhomogeneous chiral phase is observed only for one of the two discretizations. Our results suggest that this phase disappears in the continuum limit.


title: Ice mantles on dust grains: dramatic variation of thickness with grain size

abstract: We compute the desorption rate of icy mantles on dust grains as a function of the size and composition of both the grain and the mantle. We combine existing models of cosmic ray (CR) related desorption phenomena with a model of CR transport to accurately calculate the desorption rates in dark regions of molecular clouds. We show that different desorption mechanisms dominate for grains of different sizes, and in different regions of the cloud. We then use these calculations to investigate a simple model of the growth of mantles, given a distribution of grain sizes. We find that modest variations of the desorption rate with grain size lead to a strong dependence of mantle thickness on grain size. Furthermore, we show that freeze-out is almost complete in the absence of an external UV field, even when photodesorption from CR produced UV is taken into consideration. Even at gas densities of $10^4$ ${\rm cm^{-3}}$, less than 30\% of the CO remains in the gas phase after $3\times 10^5$ years for standard values of the CR ionization rate.


title: Charge density waves and Fermi-surface reconstruction in the clean overdoped cuprate superconductor Tl2Ba2CuO6+x

abstract: Hall effect and quantum oscillation measurements on high temperature cuprate superconductors show that underdoped compositions have a small Fermi surface pocket whereas when heavily overdoped, the pocket increases dramatically in size. The origin of this change in electronic structure has been unclear, but may be related to the high temperature superconductivity. Here we show that the clean overdoped single-layer cuprate Tl2Ba2CuO6+x (Tl2201) displays CDW order with a remarkably long correlation length $\xi \approx 200$ \r{A} which disappears above a hole concentration p_CDW ~ 0.265. We show that the evolution of the electronic properties of Tl2201 as the doping is lowered may be explained by a Fermi surface reconstruction which accompanies the emergence of the CDW below p_CDW. Our results demonstrate importance of CDW correlations in understanding the electronic properties of overdoped cuprates.


title: Path Integral Monte Carlo Simulations of liquid $^3$He without Fixed Nodes: Structural Properties and Collective Excitations

abstract: We present extensive new \emph{ab initio} path integral Monte Carlo (PIMC) simulations of normal liquid $^3$He without any nodal constraints. This allows us to study the effects of temperature on different structural properties like the static structure factor $S(\mathbf{q})$, the momentum distribution $n(\mathbf{q})$, and the static density response function $\chi(\mathbf{q})$, and to unambiguously quantify the impact of Fermi statistics. In addition, the dynamic structure factor $S(\mathbf{q},\omega)$ is rigorously reconstructed from imaginary-time PIMC data, and we find the familiar phonon-maxon-roton dispersion that is well known from $^4$He and has been reported previously for two-dimensional $^3$He films [Nature \textbf{483}, 576-579 (2012)]. The comparison of our new results for both $S(\mathbf{q})$ and $S(\mathbf{q},\omega)$ to neutron scattering measurements reveals an excellent agreement between theory and experiment.


title: Single Molecule SERS in a Single Gold Nanoparticle-driven Thermoplasmonic Tweezer

abstract: Surface enhanced Raman scattering (SERS) is optically sensitive and chemically specific to detect single molecule spectroscopic signatures. Facilitating this capability in optically-trapped nanoparticles at low laser power remains a significant challenge. In this letter, we show single molecule SERS signatures in reversible assemblies of trapped plasmonic nanoparticles using a single laser excitation (633 nm). Importantly, this trap is facilitated by the thermoplasmonic field of a single gold nanoparticle dropcasted on a glass surface. We employ bi-analyte SERS technique to ascertain the single molecule statistical signatures, and identify the critical parameters of the thermoplasmonic tweezer that provide this sensitivity. Furthermore, we show the utility of this low power ($\approx$0.1 mW/$\mu$m^2) tweezer platform to trap single gold nanoparticle and transport assembly of nanoparticles. Given that our configuration is based on a dropcasted gold nanoparticle, we envisage its utility to create reconfigurable plasmonic metafluids in physiological and catalytic environments, and can be potentially adapted as an in-vivo plasmonic tweezer.

categories: physics.optics cond-mat.mes-hall cond-mat.soft physics.app-ph


title: Cartography Active Learning

abstract: We propose Cartography Active Learning (CAL), a novel Active Learning (AL) algorithm that exploits the behavior of the model on individual instances during training as a proxy to find the most informative instances for labeling. CAL is inspired by data maps, which were recently proposed to derive insights into dataset quality (Swayamdipta et al., 2020). We compare our method on popular text classification tasks to commonly used AL strategies, which instead rely on post-training behavior. We demonstrate that CAL is competitive to other common AL methods, showing that training dynamics derived from small seed data can be successfully used for AL. We provide insights into our new AL method by analyzing batch-level statistics utilizing the data maps. Our results further show that CAL results in a more data-efficient learning strategy, achieving comparable or better results with considerably less training data.


title: Microlensing constraints on axion stars including finite lens and source size effects

abstract: A fraction of light scalar dark matter, especially axions, may organize into Bose-Einstein condensates, gravitationally bound clumps, "boson stars", and be present in large number in galactic halos today. We compute the expected number of gravitational microlensing events of clumps composed of the ordinary QCD axion and axion-like-particles and derive microlensing constraints from the EROS-2 survey and the Subaru Hyper Suprime-Cam observation. We perform a detailed lensing calculation, including the finite lens and source size effects in our analysis. We constrain the axion mass in terms of the fraction of dark matter collapsed into clumps, the individual clump densities, and the axion self-coupling. We also consider and constrain clumps composed of a generic scalar dark matter candidate with repulsive self-interactions. Our analysis opens up a new window for the potential discovery of dark matter.


title: Towards Robust Cross-domain Image Understanding with Unsupervised Noise Removal

abstract: Deep learning models usually require a large amount of labeled data to achieve satisfactory performance. In multimedia analysis, domain adaptation studies the problem of cross-domain knowledge transfer from a label rich source domain to a label scarce target domain, thus potentially alleviates the annotation requirement for deep learning models. However, we find that contemporary domain adaptation methods for cross-domain image understanding perform poorly when source domain is noisy. Weakly Supervised Domain Adaptation (WSDA) studies the domain adaptation problem under the scenario where source data can be noisy. Prior methods on WSDA remove noisy source data and align the marginal distribution across domains without considering the fine-grained semantic structure in the embedding space, which have the problem of class misalignment, e.g., features of cats in the target domain might be mapped near features of dogs in the source domain. In this paper, we propose a novel method, termed Noise Tolerant Domain Adaptation, for WSDA. Specifically, we adopt the cluster assumption and learn cluster discriminatively with class prototypes in the embedding space. We propose to leverage the location information of the data points in the embedding space and model the location information with a Gaussian mixture model to identify noisy source data. We then design a network which incorporates the Gaussian mixture noise model as a sub-module for unsupervised noise removal and propose a novel cluster-level adversarial adaptation method which aligns unlabeled target data with the less noisy class prototypes for mapping the semantic structure across domains. We conduct extensive experiments to evaluate the effectiveness of our method on both general images and medical images from COVID-19 and e-commerce datasets. The results show that our method significantly outperforms state-of-the-art WSDA methods.


title: Energy-Efficient Mobile Robot Control via Run-time Monitoring of Environmental Complexity and Computing Workload

abstract: We propose an energy-efficient controller to minimize the energy consumption of a mobile robot by dynamically manipulating the mechanical and computational actuators of the robot. The mobile robot performs real-time vision-based applications based on an event-based camera. The actuators of the controller are CPU voltage/frequency for the computation part and motor voltage for the mechanical part. We show that independently considering speed control of the robot and voltage/frequency control of the CPU does not necessarily result in an energy-efficient solution. In fact, to obtain the highest efficiency, the computation and mechanical parts should be controlled together in synergy. We propose a fast hill-climbing optimization algorithm to allow the controller to find the best CPU/motor configuration at run-time and whenever the mobile robot is facing a new environment during its travel. Experimental results on a robot with Brushless DC Motors, Jetson TX2 board as the computing unit, and a DAVIS-346 event-based camera show that the proposed control algorithm can save battery energy by an average of 50.5%, 41%, and 30%, in low-complexity, medium-complexity, and high-complexity environments, over baselines.


title: NTS-NOTEARS: Learning Nonparametric DBNs With Prior Knowledge

abstract: We describe NTS-NOTEARS, a score-based structure learning method for time-series data to learn dynamic Bayesian networks (DBNs) that captures nonlinear, lagged (inter-slice) and instantaneous (intra-slice) relations among variables. NTS-NOTEARS utilizes 1D convolutional neural networks (CNNs) to model the dependence of child variables on their parents; 1D CNN is a neural function approximation model well-suited for sequential data. DBN-CNN structure learning is formulated as a continuous optimization problem with an acyclicity constraint, following the NOTEARS DAG learning approach. We show how prior knowledge of dependencies (e.g., forbidden and required edges) can be included as additional optimization constraints. Empirical evaluation on simulated and benchmark data show that NTS-NOTEARS achieves state-of-the-art DAG structure quality compared to both parametric and nonparametric baseline methods, with improvement in the range of 10-20% on the F1-score. We also evaluate NTS-NOTEARS on complex real-world data acquired from professional ice hockey games that contain a mixture of continuous and discrete variables. The code is available online.


title: Properties of the C II 1334 {\AA} line in Coronal Hole and Quiet Sun as observed by IRIS

abstract: Coronal Holes (CHs) have subdued intensity and net blueshifts when compared to Quiet Sun (QS) at coronal temperatures. At transition region temperatures, such differences are obtained for regions with identical photospheric absolute magnetic flux density ($\vert$B$\vert$). In this work, we use spectroscopic measurements of the \car 1334~{\AA} line from Interface Region Imaging Spectrograph (IRIS), formed at chromospheric temperatures, to investigate the intensity, Doppler shift, line width, skew, and excess kurtosis variations with $\vert$B$\vert$. We find the intensity, Doppler shift, and line widths to increase with $\vert$B$\vert$ for CHs and QS. The CHs show deficit in intensity and excess total widths over QS for regions with identical $\vert$B$\vert$. For pixels with only upflows, CHs show excess upflows over QS, while for pixels with only downflows, CHs show excess downflows over QS that cease to exist at $\vert$B$\vert$ $\le$ 40. Finally, the spectral profiles are found to be more skewed and flatter than a Gaussian, with no difference between CH and QS. These results are important in understanding the heating of the atmosphere in CH and QS, including solar wind formation, and provide further constraints on the modeling of the solar atmosphere.


title: Posterior Concentration Rates for Bayesian Penalized Splines

abstract: Despite their widespread use in practice, the asymptotic properties of Bayesian penalized splines have not been investigated so far. We close this gap and study posterior concentration rates for Bayesian penalized splines in a Gaussian nonparametric regression model. A key feature of the approach is the hyperprior on the smoothing variance, which allows for adaptive smoothing in practice but complicates the theoretical analysis considerably as it destroys conjugacy and precludes analytic expressions for the posterior moments. To derive our theoretical results, we rely on several new concepts including a carefully defined proper version of the partially improper penalized splines prior as well as an innovative spline estimator that projects the observations onto the first basis functions of a Demmler-Reinsch basis. Our results show that posterior concentration at near optimal rate can be achieved if the hyperprior on the smoothing variance strikes a fine balance between oversmoothing and undersmoothing, which can for instance be met by a Weibull hyperprior with shape parameter 1/2. We complement our theoretical results with empirical evidence demonstrating the adaptivity of the hyperprior in practice.


title: Riemannian Stochastic Hybrid Gradient Algorithm for Nonconvex Optimization

abstract: In recent years, Riemannian stochastic gradient descent (R-SGD), Riemannian stochastic variance reduction (R-SVRG) and Riemannian stochastic recursive gradient (R-SRG) have attracted considerable attention on Riemannian optimization. Under normal circumstances, it is impossible to analyze the convergence of R-SRG algorithm alone. The main reason is that the conditional expectation of the descending direction is a biased estimation. However, in this paper, we consider linear combination of three descent directions on Riemannian manifolds as the new descent direction (i.e., R-SRG, R-SVRG and R-SGD) and the parameters are time-varying. At first, we propose a Riemannian stochastic hybrid gradient(R-SHG) algorithm with adaptive parameters. The algorithm gets a global convergence analysis with a decaying step size. For the case of step-size is fixed, we consider two cases with the inner loop fixed and time-varying. Meanwhile, we quantitatively research the convergence speed of the algorithm. Since the global convergence of the R-SHG algorithm with adaptive parameters requires higher functional differentiability, we propose a R-SHG algorithm with time-varying parameters. And we obtain similar conclusions under weaker conditions.


title: Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss

abstract: Employing large-scale pre-trained model CLIP to conduct video-text retrieval task (VTR) has become a new trend, which exceeds previous VTR methods. Though, due to the heterogeneity of structures and contents between video and text, previous CLIP-based models are prone to overfitting in the training phase, resulting in relatively poor retrieval performance. In this paper, we propose a multi-stream Corpus Alignment network with single gate Mixture-of-Experts (CAMoE) and a novel Dual Softmax Loss (DSL) to solve the two heterogeneity. The CAMoE employs Mixture-of-Experts (MoE) to extract multi-perspective video representations, including action, entity, scene, etc., then align them with the corresponding part of the text. In this stage, we conduct massive explorations towards the feature extraction module and feature alignment module. DSL is proposed to avoid the one-way optimum-match which occurs in previous contrastive methods. Introducing the intrinsic prior of each pair in a batch, DSL serves as a reviser to correct the similarity matrix and achieves the dual optimal match. DSL is easy to implement with only one-line code but improves significantly. The results show that the proposed CAMoE and DSL are of strong efficiency, and each of them is capable of achieving State-of-The-Art (SOTA) individually on various benchmarks such as MSR-VTT, MSVD, and LSMDC. Further, with both of them, the performance is advanced to a big extend, surpassing the previous SOTA methods for around 4.6\% R@1 in MSR-VTT.


title: Syntax and Consequence Relations -- A Categorical Perspective

abstract: In this paper, we use a categorical and functorial set up to model the syntax and inference of logics with algebraic signature, extending previous works on algebraisation of logics. The main feature of this work is that structurality, or invariance under substitution of variables, are modelled by functoriality, resulting in a much clearer framework for algebraic semantics and algebraisation. It also provides a very nice conceptual understanding of various existing results already established in the literatures, and derives several new results as well.


title: Generalised Unsupervised Domain Adaptation of Neural Machine Translation with Cross-Lingual Data Selection

abstract: This paper considers the unsupervised domain adaptation problem for neural machine translation (NMT), where we assume the access to only monolingual text in either the source or target language in the new domain. We propose a cross-lingual data selection method to extract in-domain sentences in the missing language side from a large generic monolingual corpus. Our proposed method trains an adaptive layer on top of multilingual BERT by contrastive learning to align the representation between the source and target language. This then enables the transferability of the domain classifier between the languages in a zero-shot manner. Once the in-domain data is detected by the classifier, the NMT model is then adapted to the new domain by jointly learning translation and domain discrimination tasks. We evaluate our cross-lingual data selection method on NMT across five diverse domains in three language pairs, as well as a real-world scenario of translation for COVID-19. The results show that our proposed method outperforms other selection baselines up to +1.5 BLEU score.


title: Semi-regular red giants as distance indicators I. The period-luminosity relations of semi-regular variables revisited

abstract: Semi-regular variables (SRVs) are similar to Miras in brightness, and they also follow PLRs, though not necessarily the same as Miras. As potential standard candles they are more challenging than Miras due to their smaller variability amplitudes and less regular light curves, but they are substantially more numerous and especially promising to probe old stellar populations. We aim to characterize the variability of SRVs, with focus on their connection with Miras, in order to prepare the ground for investigating their potential as distance indicators. We examine SRVs and Miras in the Magellanic Clouds from OGLE-III observations, with data from Gaia and 2MASS. After cleaning the sample from variability periods unrelated to pulsation, we classify each source by chemical type and combination of pulsation modes. We examine the results in terms of global photometric and pulsation properties. We identify four SRVs groups that fit the general evolutionary scenario predicted by theory. SRVs dominated by fundamental-mode pulsation are very similar to Miras, especially if mono-periodic. They further split into two sub-groups, one of which follows the same sequence as Miras in the period-luminosity and period-amplitude diagram, without discontinuity. The similarities between Miras and SRVs suggest that the latter can be adopted as complementary distance indicators to the former, thereby at least doubling the available number of LPVs suitable for use as distance indicators. The traditional amplitude-based separation between Miras and SRVs is not necessarily appropriate, and a more physically sound criterion should also involve pulsation periods. While this would require comparatively longer time series, they are expected to become accessible in the coming years even for weak sources thanks to current and future large-scale surveys. The table of reclassified LPVs is made public.