title: $2 \times 2$ Zero-Sum Games with Commitments and Noisy Observations

abstract: In this paper, $2\times2$ zero-sum games are studied under the following assumptions: $(1)$ One of the players (the leader) commits to choose its actions by sampling a given probability measure (strategy); $(2)$ The leader announces its action, which is observed by its opponent (the follower) through a binary channel; and $(3)$ the follower chooses its strategy based on the knowledge of the leader's strategy and the noisy observation of the leader's action. Under these conditions, the equilibrium is shown to always exist. Interestingly, even subject to noise, observing the actions of the leader is shown to be either beneficial or immaterial for the follower. More specifically, the payoff at the equilibrium of this game is upper bounded by the payoff at the Stackelberg equilibrium (SE) in pure strategies; and lower bounded by the payoff at the Nash equilibrium, which is equivalent to the SE in mixed strategies.Finally, necessary and sufficient conditions for observing the payoff at equilibrium to be equal to its lower bound are presented. Sufficient conditions for the payoff at equilibrium to be equal to its upper bound are also presented.

categories: cs.GT cs.IT cs.LG math.IT math.ST stat.ML stat.TH


title: Cutting Through the Noise: An Empirical Comparison of Psychoacoustic and Envelope-based Features for Machinery Fault Detection

abstract: Acoustic-based fault detection has a high potential to monitor the health condition of mechanical parts. However, the background noise of an industrial environment may negatively influence the performance of fault detection. Limited attention has been paid to improving the robustness of fault detection against industrial environmental noise. Therefore, we present the Lenze production background-noise (LPBN) real-world dataset and an automated and noise-robust auditory inspection (ARAI) system for the end-of-line inspection of geared motors. An acoustic array is used to acquire data from motors with a minor fault, major fault, or which are healthy. A benchmark is provided to compare the psychoacoustic features with different types of envelope features based on expert knowledge of the gearbox. To the best of our knowledge, we are the first to apply time-varying psychoacoustic features for fault detection. We train a state-of-the-art one-class-classifier, on samples from healthy motors and separate the faulty ones for fault detection using a threshold. The best-performing approaches achieve an area under curve of 0.87 (logarithm envelope), 0.86 (time-varying psychoacoustics), and 0.91 (combination of both).


title: A speech corpus for chronic kidney disease

abstract: In this study, we present a speech corpus of patients with chronic kidney disease (CKD) that will be used for research on pathological voice analysis, automatic illness identification, and severity prediction. This paper introduces the steps involved in creating this corpus, including the choice of speech-related parameters and speech lists as well as the recording technique. The speakers in this corpus, 289 CKD patients with varying degrees of severity who were categorized based on estimated glomerular filtration rate (eGFR), delivered sustained vowels, sentence, and paragraph stimuli. This study compared and analyzed the voice characteristics of CKD patients with those of the control group; the results revealed differences in voice quality, phoneme-level pronunciation, prosody, glottal source, and aerodynamic parameters.


title: Minimum-Time Escape from a Circular Region for a Dubins Car

abstract: We investigate the problem of finding paths that enable a robot modeled as a Dubins car (i.e., a constant-speed finite-turn-rate unicycle) to escape from a circular region of space in minimum time. This minimum-time escape problem arises in marine, aerial, and ground robotics in situations where a safety region has been violated and must be exited before a potential negative consequence occurs (e.g., a collision). Using the tools of nonlinear optimal control theory, we show that a surprisingly simple closed-form feedback control law solves this minimum-time escape problem, and that the minimum-time paths have an elegant geometric interpretation.


title: Electrostatic effects of the MnBi2Te4-superconductor hetero-structures in chiral Majorana search

abstract: The realization of chiral Majorana modes is a challenging task. We aim to comprehend the phase diagrams and parameter control capabilities of the actual devices used in the chiral Majorana search. Beyond the well-known minimal models, we develop a numerical simulation scheme using a self-consistent Schrodinger-Poisson approach to study, as an example, the MnBi2Te4 thin film coupled to an s-wave superconductor. We show that both the superconducting proximity effect and the tunability of the chemical potential for the topological surface states are significantly influenced by the gate-induced electrostatic potential. This complicates the implementation in experiments, and the actual topological region will be narrowed in stark contrast to those predicted in the previous minimal models. Nevertheless, we demonstrate that the chiral Majorana mode still exists in a wide range of experimental parameters with practical tunability.


title: Ionising feedback from an O star formed in a shock-compressed layer

abstract: We develop a simple analytic model for what happens when an O star (or compact cluster of OB stars) forms in a shock compressed layer and carves out an approximately circular hole in the layer, at the waist of a bipolar HII Region (HIIR). The model is characterised by three parameters: the half-thickness of the undisturbed layer, Zlay, the mean number-density of hydrogen molecules in the undisturbed layer, nlay, and the (collective) ionising output of the star(s), NdotLyC. The radius of the circular hole is given by WIF ~ 3.8 pc [Zlay/0.1pc]^{-1/6} [nlay/10^4cm^{-3}]^{-1/3} [NdotLyC/10^{49} s^{-1}]^{1/6} [t/Myr]^{2/3}. Similar power-law expressions are obtained for the rate at which ionised gas is fed into the bipolar lobes; the rate at which molecular gas is swept up into a dense ring by the shock front (SF) that precedes the ionisation front (IF); and the density in this dense ring. We suggest that our model might be a useful zeroth-order representation of many observed HIIRs. From viewing directions close to the midplane of the layer, the HIIR will appear bipolar. From viewing directions approximately normal to the layer it will appear to be a limb-brightened shell but too faint through the centre to be a spherically symmetric bubble. From intermediate viewing angles more complicated morphologies can be expected.


title: Dynamic phase transitions on the kagome Ising ferromagnet

abstract: We perform extensive Monte Carlo simulations to investigate the dynamic phase transition properties of the two-dimensional kinetic Ising model on the kagome lattice in the presence of square-wave oscillating magnetic field. Through detailed finite-size scaling analysis, we study universality aspects of the non-equilibrium phase transition. Obtained critical exponents indicate that the two-dimensional kagome-lattice kinetic Ising model belongs to the same universality class with the corresponding Ising model in equilibrium. Moreover, dynamic critical exponent of the local moves used in simulations is determined with high precision. Our numerical results are compatible with the previous ones on kinetic Ising models.


title: Bernoulli variables, classical exclusion processes and free probability

abstract: We present a new description of the known large deviation function of the classical symmetric simple exclusion process by exploiting its connection with the quantum symmetric simple exclusion processes and using tools from free probability. This may seem paradoxal as free probability usually deals with non commutative probability while the simple exclusion process belongs to the realm of classical probability. On the way, we give a new formula for the free energy -- alias the logarithm of the Laplace transform of the probability distribution -- of correlated Bernoulli variables in terms of the set of their cumulants with non-coinciding indices. This latter result is obtained either by developing a combinatorial approach for cumulants of products of random variables or by borrowing techniques from Feynman graphs.

categories: math-ph cond-mat.stat-mech math.MP math.PR


title: Charmed-strange tetraquarks and their decays in a potential quark model

abstract: In the framework of a nonrelativistic potential quark model, we investigate the mass spectrum of the $1S$-wave charmed-strange tetraquark states of $cn\bar{s}\bar{n}$ and $cs\bar{n}\bar{n}$ ($n=u$ or $d$) systems. The tetraquark system is solved by a correlated Gaussian method. With the same parameters fixed by the meson spectra, we obtained the mass spectra for the $1S$-wave tetraquark states. Furthermore, based on the predicted tetraquark spectra we estimate their rearrangement decays in a quark-exchange model. We find that the rearrangement decays of the tetraquarks may be mainly driven by the spin-spin interactions. The resonances $X_0(2900)^0$ and $T^a_{c\bar{s}0}(2900)^{++/0}$ reported from LHCb may be assigned to be the lowest $1S$-wave tetraquark states $\bar{T}_{cs0}^f(2818)$ and $T^{a}_{c\bar{s}0}(2828)$ classified in the quark model, respectively. It also allows us to extract the couplings for the initial tetraquark states to their nearby $S$-wave interaction channels. We find that some of these couplings turn out to be sizeable. Following the picture of the wavefunction renormalization for the near-threshold strong $S$-wave interactions, the sizeable coupling strengths can be regarded as an indication of their dynamic origins as candidates for hadronic molecules. Furthermore, our predictions suggest that signals for the $1S$-wave charmed-strange tetraquark states can also be searched in the other channels, such as $D^0K^+$, $D^+K^+$, $D^{*+}K^-$, $D^{*+}K^+$, $D^{*0}K^+$, $D^0\bar{K}^{*0}$, $D_s^+\rho^0$, etc.


title: Trust Management for Internet of Things: A Systematic Literature Review

abstract: Internet of Things (IoT) is a network of devices that communicate with each other through the internet and provides intelligence to industry and people. These devices are running in potentially hostile environments, so the need for security is critical. Trust Management aims to ensure the reliability of the network by assigning a trust value in every node indicating its trust level. This paper presents an exhaustive survey of the current Trust Management techniques for IoT, a classification based on the methods used in every work and a discussion of the open challenges and future research directions.


title: iGniter: Interference-Aware GPU Resource Provisioning for Predictable DNN Inference in the Cloud

abstract: GPUs are essential to accelerating the latency-sensitive deep neural network (DNN) inference workloads in cloud datacenters. To fully utilize GPU resources, spatial sharing of GPUs among co-located DNN inference workloads becomes increasingly compelling. However, GPU sharing inevitably brings severe performance interference among co-located inference workloads, as motivated by an empirical measurement study of DNN inference on EC2 GPU instances. While existing works on guaranteeing inference performance service level objectives (SLOs) focus on either temporal sharing of GPUs or reactive GPU resource scaling and inference migration techniques, how to proactively mitigate such severe performance interference has received comparatively little attention. In this paper, we propose iGniter, an interference-aware GPU resource provisioning framework for cost-efficiently achieving predictable DNN inference in the cloud. iGniter is comprised of two key components: (1) a lightweight DNN inference performance model, which leverages the system and workload metrics that are practically accessible to capture the performance interference; (2) A cost-efficient GPU resource provisioning strategy that jointly optimizes the GPU resource allocation and adaptive batching based on our inference performance model, with the aim of achieving predictable performance of DNN inference workloads. We implement a prototype of iGniter based on the NVIDIA Triton inference server hosted on EC2 GPU instances. Extensive prototype experiments on four representative DNN models and datasets demonstrate that iGniter can guarantee the performance SLOs of DNN inference workloads with practically acceptable runtime overhead, while saving the monetary cost by up to 25% in comparison to the state-of-the-art GPU resource provisioning strategies.


title: Skyrmion Jellyfish in Driven Chiral Magnets

abstract: Chiral magnets can host topological particles known as skyrmions, which carry an exactly quantised topological charge $Q=-1$. In the presence of an oscillating magnetic field ${\bf B}_1(t)$, a single skyrmion embedded in a ferromagnetic background will start to move with constant velocity ${\bf v}_{\text{trans}}$. The mechanism behind this motion is similar to the one used by a jellyfish when it swims through water. We show that the skyrmion's motion is a universal phenomenon, arising in any magnetic system with translational modes. By projecting the equation of motion onto the skyrmion's translational modes and going to quadratic order in ${\bf B}_1(t)$, we obtain an analytical expression for ${\bf v}_{\text{trans}}$ as a function of the system's linear response. The linear response and consequently ${\bf v}_{\text{trans}}$ are influenced by the skyrmion's internal modes and scattering states, as well as by the ferromagnetic background's Kittel mode. The direction and speed of ${\bf v}_{\text{trans}}$ can be controlled by changing the polarisation, frequency and phase of the driving field ${\bf B}_1(t)$. For systems with small Gilbert damping parameter $\alpha$, we identify two distinct physical mechanisms used by the skyrmion to move. At low driving frequencies, the skyrmion's motion is driven by friction, and $v_{\text{trans}}\sim\alpha$, whereas at higher frequencies above the ferromagnetic gap, the skyrmion moves by magnon emission, and $v_{\text{trans}}$ becomes independent of $\alpha$.


title: On the Equality of Three Formulas for Brumer--Stark Units

abstract: We prove the equality of three conjectural formulas for the Brumer--Stark units. The first formula has essentially been proven, so the present paper also verifies the validity of the other two formulas.


title: Discussion of Features for Acoustic Anomaly Detection under Industrial Disturbing Noise in an End-of-Line Test of Geared Motors

abstract: In the end-of-line test of geared motors, the evaluation of product qual-ity is important. Due to time constraints and the high diversity of variants, acous-tic measurements are more economical than vibration measurements. However, the acoustic data is affected by industrial disturbing noise. Therefore, the aim of this study is to investigate the robustness of features used for anomaly detection in geared motor end-of-line testing. A real-world dataset with typical faults and acoustic disturbances is recorded by an acoustic array. This includes industrial noise from the production and systematically produced disturbances, used to compare the robustness. Overall, it is proposed to apply features extracted from a log-envelope spectrum together with psychoacoustic features. The anomaly de-tection is done by using the isolation forest or the more universal bagging random miner. Most disturbances can be circumvented, while the use of a hammer or air pressure often causes problems. In general, these results are important for condi-tion monitoring tasks that are based on acoustic or vibration measurements. Fur-thermore, a real-world problem description is presented to improve common sig-nal processing and machine learning tasks.


title: Learning Hypergraphs From Signals With Dual Smoothness Prior

abstract: Hypergraph structure learning, which aims to learn the hypergraph structures from the observed signals to capture the intrinsic high-order relationships among the entities, becomes crucial when a hypergraph topology is not readily available in the datasets. There are two challenges that lie at the heart of this problem: 1) how to handle the huge search space of potential hyperedges, and 2) how to define meaningful criteria to measure the relationship between the signals observed on nodes and the hypergraph structure. In this paper, for the first challenge, we adopt the assumption that the ideal hypergraph structure can be derived from a learnable graph structure that captures the pairwise relations within signals. Further, we propose a hypergraph structure learning framework HGSL with a novel dual smoothness prior that reveals a mapping between the observed node signals and the hypergraph structure, whereby each hyperedge corresponds to a subgraph with both node signal smoothness and edge signal smoothness in the learnable graph structure. Finally, we conduct extensive experiments to evaluate HGSL on both synthetic and real world datasets. Experiments show that HGSL can efficiently infer meaningful hypergraph topologies from observed signals.


title: The SPHERE view of multiple star formation

abstract: While a large fraction of the stars are in multiple systems, our understanding of the processes leading to the formation of these systems is still inadequate. Given the large theoretical uncertainties, observation plays a basic role. Here we discuss the contribution of high contrast imaging, and more specifically of the SPHERE instrument at the ESO Very Large Telescope, in this area. SPHERE nicely complements other techniques - in particular those exploiting Gaia and ALMA - in detecting and characterising systems near the peak of the distribution with separation and allows to capture snapshots of binary formation within disks that are invaluable for the understanding of disk fragmentation.

categories: astro-ph.SR astro-ph.EP astro-ph.GA astro-ph.IM


title: Design and preliminary operation of a laser absorption diagnostic for the SPIDER RF source

abstract: The ITER Heating Neutral Beam (HNB) injector is required to deliver 16.7 MW power into the plasma from a neutralised beam of H-/D- negative ions, produced by an RF source and accelerated up to 1 MeV. To enhance the H-/D- production, the surface of the acceleration system grid facing the source (the plasma grid) will be coated with Cs because of its low work function. Cs will be routinely evaporated in the source by means of specific ovens. Monitoring the evaporation rate and the distribution of Cs inside the source is fundamental to get the desired performances on the ITER HNB. In order to proper design the source of the ITER HNB and to identify the best operation practices for it, the prototype RF negative ion source SPIDER has been developed and built in the Neutral Beam Test Facility at Consorzio RFX. A Laser Absorption Spectroscopy diagnostic will be installed in SPIDER for a quantitative estimation of Cs density. By using a wavelength tunable laser, the diagnostic will measure the absorption spectrum of the 852 nm line along 4 lines of sight, parallel to the plasma grid surface and close to it. From the absorption spectra the line-integrated density of Cs at ground state will be measured. The design of this diagnostic for SPIDER is presented, with details of the layout and of the key components. A preliminary installation of the diagnostic on the test stand for Cs ovens is also described, together with its first experimental results; the effect of ground state depopulation on collected measurements is discussed and partially corrected.


title: Response Times Parametric Estimation of Real-Time Systems

abstract: Real-time systems are a set of programs, a scheduling policy and a system architecture, constrained by timing requirements. Most of daily embedded devices are real-time systems, e.g. airplanes, cars, trains, spatial probes, etc. The time required by a program for its end-to-end execution is called its response time. Usually, upper-bounds of response times are computed in order to provide safe deadline miss probabilities. In this paper, we propose a suited re-parametrization of the inverse Gaussian mixture distribution adapted to response times of real-time systems and the estimation of deadline miss probabilities. The parameters and their associated deadline miss probabilities are estimated with an adapted Expectation-Maximization algorithm.


title: Chaos in multiplanetary extrasolar systems

abstract: Here we present an initial look at the dynamics and stability of 178 multiplanetary systems which are already confirmed and listed in the NASA Exoplanet Archive. To distinguish between the chaotic and regular nature of a system, the value of the MEGNO indicator for each system was determined. Almost three-quarters of them could be labelled as long-term stable. Only 45 studied systems show chaotic behaviour. We consequently investigated the effects of the number of planets and their parameters on the system stability. A comparison of results obtained using the MEGNO indicator and machine-learning algorithm SPOCK suggests that the SPOCK could be used as an effective tool for reviewing the stability of multiplanetary systems. A similar study was already published by Laskar and Petit in 2017. We compared their analysis based on the AMD criterion with our results. The possible discrepancies are discussed.


title: H_eval: A new hybrid evaluation metric for automatic speech recognition tasks

abstract: Many studies have examined the shortcomings of word error rate (WER) as an evaluation metric for automatic speech recognition (ASR) systems. Since WER considers only literal word-level correctness, new evaluation metrics based on semantic similarity such as semantic distance (SD) and BERTScore have been developed. However, we found that these metrics have their own limitations, such as a tendency to overly prioritise keywords. We propose H_eval, a new hybrid evaluation metric for ASR systems that considers both semantic correctness and error rate and performs significantly well in scenarios where WER and SD perform poorly. Due to lighter computation compared to BERTScore, it offers 49 times reduction in metric computation time. Furthermore, we show that H_eval correlates strongly with downstream NLP tasks. Also, to reduce the metric calculation time, we built multiple fast and lightweight models using distillation techniques


title: Model-Checking for First-Order Logic with Disjoint Paths Predicates in Proper Minor-Closed Graph Classes

abstract: The disjoint paths logic, FOL+DP, is an extension of First-Order Logic (FOL) with the extra atomic predicate $\mathsf{dp}_k(x_1,y_1,\ldots,x_k,y_k),$ expressing the existence of internally vertex-disjoint paths between $x_i$ and $y_i,$ for $i\in\{1,\ldots, k\}$. This logic can express a wide variety of problems that escape the expressibility potential of FOL. We prove that for every proper minor-closed graph class, model-checking for FOL+DP can be done in quadratic time. We also introduce an extension of FOL+DP, namely the scattered disjoint paths logic, FOL+SDP, where we further consider the atomic predicate $s{\sf -sdp}_k(x_1,y_1,\ldots,x_k,y_k),$ demanding that the disjoint paths are within distance bigger than some fixed value $s$. Using the same technique we prove that model-checking for FOL+SDP can be done in quadratic time on classes of graphs with bounded Euler genus.


title: Learning Control by Iterative Inversion

abstract: We propose $\textit{iterative inversion}$ -- an algorithm for learning an inverse function without input-output pairs, but only with samples from the desired output distribution and access to the forward function. The key challenge is a $\textit{distribution shift}$ between the desired outputs and the outputs of an initial random guess, and we prove that iterative inversion can steer the learning correctly, under rather strict conditions on the function. We apply iterative inversion to learn control. Our input is a set of demonstrations of desired behavior, given as video embeddings of trajectories (without actions), and our method iteratively learns to imitate trajectories generated by the current policy, perturbed by random exploration noise. Our approach does not require rewards, and only employs supervised learning, which can be easily scaled to use state-of-the-art trajectory embedding techniques and policy representations. Indeed, with a VQ-VAE embedding, and a transformer-based policy, we demonstrate non-trivial continuous control on several tasks. Further, we report an improved performance on imitating diverse behaviors compared to reward based methods.


title: Distributed Reconfiguration of Spanning Trees

abstract: In a reconfiguration problem, given a problem and two feasible solutions of the problem, the task is to find a sequence of transformations to reach from one solution to the other such that every intermediate state is also a feasible solution to the problem. In this paper, we study the distributed spanning tree reconfiguration problem and we define a new reconfiguration step, called $k$-simultaneous add and delete, in which every node is allowed to add at most $k$ edges and delete at most $k$ edges such that multiple nodes do not add or delete the same edge. We first observe that, if the two input spanning trees are rooted, then we can do the reconfiguration using a single $1$-simultaneous add and delete step in one round in the CONGEST model. Therefore, we focus our attention towards unrooted spanning trees and show that transforming an unrooted spanning tree into another using a single $1$-simultaneous add and delete step requires $\Omega(n)$ rounds in the LOCAL model. We additionally show that transforming an unrooted spanning tree into another using a single $2$-simultaneous add and delete step can be done in $O(\log n)$ rounds in the CONGEST model.


title: SQUID: Faster Analytics via Sampled Quantiles Data-structure

abstract: Measurement is a fundamental enabler of network applications such as load balancing, attack detection and mitigation, and traffic engineering. A key building block in many critical measurement tasks is \emph{q-MAX}, where we wish to find the largest $q$ values in a number stream. A standard approach of maintaining a heap of the largest $q$ values ordered results in logarithmic runtime, which is too slow for large measurements. Modern approaches attain a constant runtime by removing small items in bulk and retaining the largest $q$ items at all times. Yet, these approaches are bottlenecked by an expensive quantile calculation method. We propose SQUID, a method that redesigns q-MAX to allow the use of \emph{approximate quantiles}, which we can compute efficiently, thereby accelerating the solution and, subsequently, many measurement tasks. We demonstrate the benefit of our approach by designing a novel weighted heavy hitters data structure that is faster and more accurate than the existing alternatives. Here, we combine our previous techniques with a lazy deletion of small entries, which expiates the maintenance process and increases the accuracy. We also demonstrate the applicability of our algorithmic approach in a general algorithmic scope by implementing the LRFU cache policy with a constant update time. Furthermore, we also show the practicality of SQUID for improving real-world networked systems, by implementing a P4 prototype of SQUID for in-network caching and demonstrating how SQUID enables a wide spectrum of score-based caching policies directly on a P4 switch.


title: Bayesian inference of vector autoregressions with tensor decompositions

abstract: Vector autoregressions (VARs) are popular in analyzing economic time series. However, VARs can be over-parameterized if the numbers of variables and lags are moderately large. Tensor VAR, a recent solution to over-parameterization, treats the coefficient matrix as a third-order tensor and estimates the corresponding tensor decomposition to achieve parsimony. In this paper, we employ the Tensor VAR structure with a CANDECOMP/PARAFAC (CP) decomposition and conduct Bayesian inference to estimate parameters. Firstly, we determine the rank by imposing the Multiplicative Gamma Prior to margins, i.e. elements in the decomposition, and accelerate the computation with an adaptive inferential scheme. Secondly, to obtain interpretable margins, we propose an interweaving algorithm to improve the mixing of margins. In the application of the US macroeconomic data, our models outperform standard VARs in point and density forecasting and yield a summary of the US economic dynamic.


title: Primordial non-gaussianity up to all orders: theoretical aspects and implications for primordial black hole models

abstract: We develop an exact formalism for the computation of the abundance of primordial black holes (PBHs) in the presence of local non-gaussianity (NG) in the curvature perturbation field. For the first time, we include NG going beyond the widely used quadratic and cubic approximations, and consider a completely generic functional form. Adopting threshold statistics of the compaction function, we address the computation of the abundance both for narrow and broad power spectra. While our formulas are generic, we discuss explicit examples of phenomenological relevance considering the physics case of the curvaton field. We carefully assess under which conditions the conventional perturbative approach can be trusted. In the case of a narrow power spectrum, this happens only if the perturbative expansion is pushed beyond the quadratic order (with the optimal order of truncation that depends on the width of the spectrum). Most importantly, we demonstrate that the perturbative approach is intrinsically flawed when considering broad spectra, in which case only the non-perturbative computation captures the correct result. Finally, we describe the phenomenological relevance of our results for the connection between the abundance of PBHs and the stochastic gravitational wave (GW) background related to their formation. As NGs modify the amplitude of perturbations necessary to produce a given PBHs abundance and boost PBHs production at large scales for broad spectra, modelling these effects is crucial to connect the PBH scenario to its signatures at current and future GWs experiments.


title: A seesaw model for large neutrino masses in concordance with cosmology

abstract: Cosmological constraints on the sum of the neutrino masses can be relaxed if the number density of active neutrinos is reduced compared to the standard scenario, while at the same time keeping the effective number of neutrino species $N_{\rm eff}\approx 3$ by introducing a new component of dark radiation. We discuss a UV complete model to realise this idea, which simultaneously provides neutrino masses via the seesaw mechanism. It is based on a $U(1)$ symmetry in the dark sector, which can be either gauged or global. In addition to heavy seesaw neutrinos, we need to introduce $\mathcal{O}(10)$ generations of massless sterile neutrinos providing the dark radiation. Then we can accommodate active neutrino masses with $\sum m_\nu \sim 1$ eV, in the sensitivity range of the KATRIN experiment. We discuss the phenomenology of the model and identify the allowed parameter space. We argue that the gauged version of the model is preferred, and in this case the typical energy scale of the model is in the 10 MeV to few GeV range.


title: Feedback is Good, Active Feedback is Better: Block Attention Active Feedback Codes

abstract: Deep neural network (DNN)-assisted channel coding designs, such as low-complexity neural decoders for existing codes, or end-to-end neural-network-based auto-encoder designs are gaining interest recently due to their improved performance and flexibility; particularly for communication scenarios in which high-performing structured code designs do not exist. Communication in the presence of feedback is one such communication scenario, and practical code design for feedback channels has remained an open challenge in coding theory for many decades. Recently, DNN-based designs have shown impressive results in exploiting feedback. In particular, generalized block attention feedback (GBAF) codes, which utilizes the popular transformer architecture, achieved significant improvement in terms of the block error rate (BLER) performance. However, previous works have focused mainly on passive feedback, where the transmitter observes a noisy version of the signal at the receiver. In this work, we show that GBAF codes can also be used for channels with active feedback. We implement a pair of transformer architectures, at the transmitter and the receiver, which interact with each other sequentially, and achieve a new state-of-the-art BLER performance, especially in the low SNR regime.


title: Data Converter Design Space Exploration for IoT Applications: An Overview of Challenges and Future Directions

abstract: Human lives are improving with the widespread use of cutting-edge digital technology like the Internet of Things (IoT). Recently, the pandemic has shown the demand for more digitally advanced IoT-based devices. International Data Corporation (IDC) forecasts that by 2025, there will be approximately 42 billion of these devices in use, capable of producing around 80 ZB (zettabytes) of data. So data acquisition, processing, communication, and visualization are necessary from a functional standpoint. Indicating sensors & data converters are the key components for IoT-based applications. The efficiency of such applications is truly measured in terms of latency, power, and resolution of data converters motivating designers to perform efficiently. Sensors capture and covert physical features from their chosen environment into detectable quantities. Data converter gives meaningful information and connects the real analog world to the digital component of the devices. The received data is interpreted and analyzed with the digital processing circuitry. Ultimately, it is used as information by a network of internet-connected smart devices. Because IoT technologies are adaptable to nearly any technology that may provide its operational activity and environmental conditions. But the challenges occur with power consumption as the complete IoT framework is battery operated and replacing a battery is a daunting task. So the goal of this chapter is to unveil the requirements to design energy-efficient data converters for IoT applications.


title: Magnetism in Two-Dimensional Ilmenenes: Intrinsic Order and Strong Anisotropy

abstract: Iron ilmenene is a new two-dimensional material that has recently been exfoliated from the naturally-occurring iron titanate found in ilmenite ore, a material that is abundant on earth surface. In this work, we theoretically investigate the structural, electronic and magnetic properties of 2D transition-metal-based ilmenene-like titanates. The study of magnetic order reveals that these ilmenenes usually present intrinsic antiferromagnetic coupling between the 3d magnetic metals decorating both sides of the Ti-O layer. Furthermore, the ilmenenes based on late 3d brass metals, such as CuTiO$_3$ and ZnTiO$_3$, become ferromagnetic and spin compensated, respectively. Our calculations including spin-orbit coupling reveal that the magnetic ilmenenes have large magnetocrystalline anisotropy energies when the 3d shell departs from being either filled or half-filled, with their spin orientation being out-of-plane for elements below half-filling of 3d states and in-plane above. These interesting magnetic properties of ilmenenes make them useful for future spintronic applications because they could be synthesized as already realized in the iron case.


title: Gradual emergence of superconductivity in underdoped LSCO

abstract: We present triple-axis neutron scattering studies of low-energy magnetic fluctuations in strongly underdoped La$_{2-x}$Sr$_{x}$CuO$_{4}$ with $x=0.05$, $0.06$ and $0.07$, providing quantitative evidence for a direct competition between these fluctuations and superconductivity. At dopings $x=0.06$ and $x=0.07$, three-dimensional superconductivity is found, while only a very weak signature of two-dimensional superconductivity residing in the CuO$_2$ planes is detectable for $x=0.05$. We find a surprising suppression of the low-energy fluctuations by an external magnetic field at all three dopings. This implies that the response of two-dimensional superconductivity to a magnetic field is similar to that of a bulk superconductor. Our results provide direct evidence of a very gradual onset of superconductivity in cuprates.


title: Tunable Chiral Bound States in a Dimer Chain of Coupled Resonators

abstract: We study the chiral feature in a system composed of one two-level emitter (TLE) and a one dimensional (1D) dimer chain of coupled resonators with the alternate single-photon energies. In the single-excitation subspace, this system not only possesses two energy bands with propagating states, but also possesses chiral bound states. The number of chiral bound states depends on the coupling forms between the TLE and the dimer chain. It is found that when the TLE is locally coupled to one resonator of the dimer chain, the bound-state that has mirror reflection symmetry is not a chiral one. When the TLE is nonlocally coupled to two adjacent resonators, three chiral bound states arise due to the mirror symmetry breaking. The chirality of these bound states can be tuned by changing the energy differences of single photon in the adjacent resonators, the coupling strengths and the transition energy of the TLE. The chirality behaviour of the ordinary two bound states outside the energy bands is quite different from the one of the emerging bound state inside the energy gap. The almost perfect chiral bound states can be achieved at certain parameters as a result of completely destructive interference.


title: Coherent control of the orbital occupation driving the insulator-to-metal Mott transition in V$_2$O$_3$

abstract: Managing light-matter interactions on timescales faster than the loss of electronic coherence is key for achieving full quantum control of the final products in solid-solid transformations. In this work, we demonstrate coherent electronic control of the photoinduced insulator-to-metal transition in the prototypical Mott insulator V$_2$O$_3$. Selective excitation of a specific interband transition with two phase-locked light pulses manipulates the orbital occupation of the correlated bands in a way that depends on the coherent evolution of the photoinduced superposition of states. A comparison between experimental results and numerical solutions of the optical Bloch equations provides an electronic coherence time on the order of 5 fs. Temperature-dependent experiments suggest that the electronic coherence time is enhanced in the vicinity of the insulator-to-metal transition critical temperature, thus highlighting the role of fluctuations in determining the electronic coherence. These results open new routes to selectively switch the functionalities of quantum materials and coherently control solid-solid electronic transformations.

categories: cond-mat.str-el cond-mat.mes-hall cond-mat.mtrl-sci physics.optics quant-ph


title: Transformers on Multilingual Clause-Level Morphology

abstract: This paper describes our winning systems in MRL: The 1st Shared Task on Multilingual Clause-level Morphology (EMNLP 2022 Workshop) designed by KUIS AI NLP team. We present our work for all three parts of the shared task: inflection, reinflection, and analysis. We mainly explore transformers with two approaches: (i) training models from scratch in combination with data augmentation, and (ii) transfer learning with prefix-tuning at multilingual morphological tasks. Data augmentation significantly improves performance for most languages in the inflection and reinflection tasks. On the other hand, Prefix-tuning on a pre-trained mGPT model helps us to adapt analysis tasks in low-data and multilingual settings. While transformer architectures with data augmentation achieved the most promising results for inflection and reinflection tasks, prefix-tuning on mGPT received the highest results for the analysis task. Our systems received 1st place in all three tasks in MRL 2022.


title: Selected results from IceCube

abstract: Neutrino astronomy saw its birth with the discovery by IceCube of a diffuse flux at energies above 60 TeV with intensity comparable to a predicted upper limit to the flux from extra-galactic sources of ultra-high energy cosmic rays (UHECRs). While such an upper limit corresponds to the case of calorimetric sources, in which cosmic rays lose all their energy into photo-pion production, the first statistically significant coincident observation between neutrinos and gamma rays was observed from a blazar of intriguing nature. A very-high-energy muon event, of most probable neutrino energy of 290 TeV for an $E^{-2.13}$ spectrum, alerted other observatories triggering a large number of investigations in many bands of the electromagnetic (EM) spectrum. A high gamma-ray state from the blazar was revealed soon after the event and in a follow-up to about 40 days. A posteriori observations also in the optical and radio bands indicated a rise of the flux from the TXS 0506+056 blazar. A previous excess of events of the duration of more than 100~d was observed by IceCube with higher significance than the alert itself. These observations triggered more complex modeling than simple one-zone proton synchrotron models for proton acceleration in jets of active galactic nuclei (AGNs) and more observations across the EM spectrum. A second piece of evidence was a steady excess of about 50 neutrino events with reconstructed soft spectrum in a sample of lower energy well-reconstructed muon events than the alert event. A hot spot was identified in a catalog of 110 gamma-ray intense emitters and starburst galaxies in a direction compatible with NGC 1068 with a significance of $2.9\sigma$. NGC 1068 hosts a mildly relativistic jet in a starburst galaxy, seen not from the jet direction but rather through the torus. This Seyfert II galaxy is at only 14.4~Mpc from the Earth. We discuss these observations.


title: Analysis of a Deep Learning Model for 12-Lead ECG Classification Reveals Learned Features Similar to Diagnostic Criteria

abstract: Despite their remarkable performance, deep neural networks remain unadopted in clinical practice, which is considered to be partially due to their lack in explainability. In this work, we apply attribution methods to a pre-trained deep neural network (DNN) for 12-lead electrocardiography classification to open this "black box" and understand the relationship between model prediction and learned features. We classify data from a public data set and the attribution methods assign a "relevance score" to each sample of the classified signals. This allows analyzing what the network learned during training, for which we propose quantitative methods: average relevance scores over a) classes, b) leads, and c) average beats. The analyses of relevance scores for atrial fibrillation (AF) and left bundle branch block (LBBB) compared to healthy controls show that their mean values a) increase with higher classification probability and correspond to false classifications when around zero, and b) correspond to clinical recommendations regarding which lead to consider. Furthermore, c) visible P-waves and concordant T-waves result in clearly negative relevance scores in AF and LBBB classification, respectively. In summary, our analysis suggests that the DNN learned features similar to cardiology textbook knowledge.


title: Modified expansion law with Kodama-Hayward temperature for the horizon

abstract: The expansion law proposed by Padmanabhan suggests that the evolution of the volume of the horizon is due to the difference between the degrees of freedom on the horizon and the degrees of freedom in the bulk enclosed by the horizon. In formulating this law, Padmanabhan used the temperature, $T=H/2\pi$, for a dynamical expansion. In this work, we modified the expansion law using Kodama-Hayward temperature, the dynamical temperature, for the horizon, first in (3+1) Einstein's gravity and extended it to higher order gravity theories such as (n+1) Einstein gravity, Gauss-Bonnet gravity, and more general Lovelock gravity. Contrary to the conventional approach, we expressed degrees of freedom of the horizon in terms of the surface energy of the horizon. Also, we have expressed modified expansion law in terms of cosmic components. It then turns out that it is possible to express the modified expansion law in a form as if $T=H/2\pi$ is the temperature of the dynamical horizon.


title: Formation and Thermodynamic Evolution of plasmoids in active region jets

abstract: We have carried out a comprehensive study of the temperature structure of plasmoids, which successively occurred in recurrent active region jets. The multithermal plasmoids were seen to be travelling along the multi-threaded spire as well as at the footpoint region in the EUV/UV images recorded by the Atmospheric Imaging Assembly (AIA). The Differential Emission Measure (DEM) analysis was performed using EUV AIA images, and the high-temperature part of the DEM was constrained by combining X-ray images from the X-ray telescope (XRT/Hinode). We observed a systematic rise and fall in brightness, electron number densities and the peak temperatures of the spire plasmoid during its propagation along the jet. The plasmoids at the footpoint (FPs) (1.0-2.5 MK) and plasmoids at the spire (SPs) (1.0-2.24 MK) were found to have similar peak temperatures, whereas the FPs have higher DEM weighted temperatures (2.2-5.7 MK) than the SPs (1.3-3.0 MK). A lower limit to the electron number densities of plasmoids - SPs (FPs) were obtained that ranged between 3.4-6.1$\times$10$^{8}$ (3.3-5.9$\times$10$^{8}$) cm$^{-3}$ whereas for the spire, it ranged from 2.6-3.2$\times$10$^{8}$ cm$^{-3}$. Our analysis shows that the emission of these plasmoids starts close to the base of the jet(s), where we believe that a strong current interface is formed. This suggests that the blobs are plasmoids induced by a tearing-mode instability.


title: On the relation between disorder and homogeneity in an amorphous metal

abstract: Disorder and homogeneity are two concepts that refer to spatial variation of the system potential. In condensed-matter systems disorder is typically divided into two types; those with local parameters varying from site to site (diagonal disorder) and those characterized by random transfer-integral values (off-diagonal disorder). Amorphous systems in particular exhibit off-diagonal disorder due to random positions of their constituents. In real systems diagonal and off-diagonal disorder may be interconnected. The formal depiction of disorder as local deviations from a common value focuses attention on the short-range components of the potential-landscape. However, long range potential fluctuation are quite common in real systems. In this work we seek to find a correlation between disorder and homogeneity using amorphous indium-oxide films with different carrier-concentrations and with different degree of disorder. Thermal treatment is used as a means of fine tuning the system disorder. In this process the resistance of the sample decreases while its amorphous structure and chemical composition is preserved. The reduced resistivity affects the Ioffe-Regel parameter that is taken as a relative measure of disorder in a given sample. The homogeneity of the system was monitored using inelastic light-scattering. This is based on collecting the Raman signal from micron-size spots across the sample. The statistics of these low-energy data are compared with the sample disorder independently estimated from transport measurements. The analysis establishes that heterogeneity and disorder are correlated.


title: On a multiplier operator induced by the Schwarzian derivative of univalent functions

abstract: In this paper we study a multiplier operator which is induced by the Schwarzian derivative of univalent functions with a quasiconformal extension to the extended complex plane. As applications, we show that the Brennan conjecture is satisfied for a large class of quasidisks. We also establish a new characterization of asymptotically conformal curves and of the Weil-Petersson curves in terms of the multiplier operator.


title: Beyond the Best: Estimating Distribution Functionals in Infinite-Armed Bandits

abstract: In the infinite-armed bandit problem, each arm's average reward is sampled from an unknown distribution, and each arm can be sampled further to obtain noisy estimates of the average reward of that arm. Prior work focuses on identifying the best arm, i.e., estimating the maximum of the average reward distribution. We consider a general class of distribution functionals beyond the maximum, and propose unified meta algorithms for both the offline and online settings, achieving optimal sample complexities. We show that online estimation, where the learner can sequentially choose whether to sample a new or existing arm, offers no advantage over the offline setting for estimating the mean functional, but significantly reduces the sample complexity for other functionals such as the median, maximum, and trimmed mean. The matching lower bounds utilize several different Wasserstein distances. For the special case of median estimation, we identify a curious thresholding phenomenon on the indistinguishability between Gaussian convolutions with respect to the noise level, which may be of independent interest.

categories: cs.LG cs.IT math.IT math.ST stat.ML stat.TH


title: The galaxy formation origin of the lensing is low problem

abstract: Recent analyses show that $\Lambda$CDM-based models optimised to reproduce the clustering of massive galaxies overestimate their gravitational lensing by about 30\%, the so-called lensing is low problem. Using a state-of-the-art hydrodynamical simulation, we show that this discrepancy reflects shortcomings in standard galaxy-halo connection models rather than tensions within the $\Lambda$CDM paradigm itself. Specifically, this problem results from ignoring a variety of galaxy formation effects, including assembly bias, segregation of satellite galaxies relative to dark matter, and baryonic effects on the matter distribution. All these effects contribute towards overestimating gravitational lensing and, when combined, explain the amplitude and scale dependence of the lensing is low problem. We conclude that simplistic galaxy-halo connection models are inadequate to interpret clustering and lensing simultaneously, and that it is crucial to employ more sophisticated models for the upcoming generation of large-scale surveys.


title: Task Tree Retrieval for Robotic Cooking

abstract: Robotics is used to foster creativity. Humans can perform jobs in their unique manner, depending on the circumstances. This situation applies to food cooking. Robotic technology in the kitchen can speed up the process and reduce its workload. However, the potential of robotics in the kitchen is still unrealized. In this essay, the idea of FOON, a structural knowledge representation built on insights from human manipulations, is introduced. To reduce the failure rate and ensure that the task is effectively completed, three different algorithms have been implemented where weighted values have been assigned to the manipulations depending on the success rates of motion. This knowledge representation was created using videos of open-sourced recipes


title: Log-density gradient covariance and automatic metric tensors for Riemann manifold Monte Carlo methods

abstract: A metric tensor for Riemann manifold Monte Carlo particularly suited for non-linear Bayesian hierarchical models is proposed. The metric tensor is built from symmetric positive semidefinite log-density gradient covariance (LGC) matrices, which are also proposed and further explored here. The LGCs generalize the Fisher information matrix by measuring the joint information content and dependence structure of both a random variable and the parameters of said variable. Consequently, positive definite Fisher/LGC-based metric tensors may be constructed not only from the observation likelihoods as is current practice, but also from arbitrarily complicated non-linear prior/latent variable structures, provided the LGC may be derived for each conditional distribution used to construct said structures. The proposed methodology is highly automatic and allows for exploitation of any sparsity associated with the model in question. When implemented in conjunction with a Riemann manifold variant of the recently proposed numerical generalized randomized Hamiltonian Monte Carlo processes, the proposed methodology is highly competitive, in particular for the more challenging target distributions associated with Bayesian hierarchical models.


title: Methodology for Simulation-based Comparison of Algorithms for Distributed Mutual Exclusion

abstract: In this paper, we show how different types of distributed mutual algorithms can be compared in terms of performance through simulations. A simulation-based approach is presented, together with an overview of the relevant evaluation metrics and approach for statistical processing of the results. The presented simulations can be used to learn master students of a course on distributed software the basics of algorithms for distributed mutual exclusion, together with how to properly conduct a detailed comparison study. Finally, a related work section is provided with relevant use cases where distributed mutual exclusion algorithm can be beneficial.


title: Electron and neutrino scattering off the deuteron in a relativistic framework

abstract: We build a relativistic model to perform calculations of exclusive, semi-exclusive and inclusive unpolarized cross sections and various polarization observables in electron and neutrino scattering experiments with deuteron targets. The strong interaction dynamics is defined by an explicit dynamical unitary representation of the Poincar\'e group, where representations of space translations and rotations in the interacting and non-interacting representations are the same. The Argonne V18 potential is used to construct a relativistic nucleon-nucleon interaction reproducing the experimental deuteron binding energy and nucleon-nucleon scattering observables. Our formalism does not include the pion production channel and neglects two-body contributions in the electromagnetic as well as in the weak nuclear current operator. We show that it is applicable to processes at kinematics, where the internal two-nucleon energy remains below the pion production threshold but the magnitude of the three-momentum transfer extends at least to several GeV.


title: Enhanced Visual Feedback with Decoupled Viewpoint Control in Immersive Humanoid Robot Teleoperation using SLAM

abstract: In immersive humanoid robot teleoperation, there are three main shortcomings that can alter the transparency of the visual feedback: the lag between the motion of the operator's and robot's head due to network communication delays or slow robot joint motion. This latency could cause a noticeable delay in the visual feedback, which jeopardizes the embodiment quality, can cause dizziness, and affects the interactivity resulting in operator frequent motion pauses for the visual feedback to settle; (ii) the mismatch between the camera's and the headset's field-of-views (FOV), the former having generally a lower FOV; and (iii) a mismatch between human's and robot's range of motions of the neck, the latter being also generally lower. In order to leverage these drawbacks, we developed a decoupled viewpoint control solution for a humanoid platform which allows visual feedback with low-latency and artificially increases the camera's FOV range to match that of the operator's headset. Our novel solution uses SLAM technology to enhance the visual feedback from a reconstructed mesh, complementing the areas that are not covered by the visual feedback from the robot. The visual feedback is presented as a point cloud in real-time to the operator. As a result, the operator is fed with real-time vision from the robot's head orientation by observing the pose of the point cloud. Balancing this kind of awareness and immersion is important in virtual reality based teleoperation, considering the safety and robustness of the control system. An experiment shows the effectiveness of our solution.


title: Disentangling the magneto-optic Kerr effect of manganite epitaxial heterostructures

abstract: Magneto-optic Kerr effect can probe the process of magnetization reversal in ferromagnetic thin films and thus be used as an alternative to magnetometry. Kerr effect is wavelength-dependent and the Kerr rotation can reverse sign, vanishing at particular wavelengths. We investigate epitaxial heterostructures of ferromagnetic manganite, La$_{0.7}$Sr$_{0.3}$Mn$_{0.9}$Ru$_{0.1}$O$_3$, by polar Kerr effect and magnetometry. The manganite layers are separated by or interfaced with a layer of nickelate, NdNiO$_3$. Kerr rotation hysteresis loops of trilayers, with two manganite layers of different thickness separated by a nickelate layer, have intriguing humplike features, when measured with light of 400 nm wavelength. By investigating additional reference samples we disentangle the contributions of the individual layers to the loops: we show that the humps originate from the opposite sense of the Kerr rotation of the two different ferromagnetic layers, combined with the additive behavior of the Kerr signal.


title: Iterative autoregression: a novel trick to improve your low-latency speech enhancement model

abstract: Streaming models are an essential component of real-time speech enhancement tools. The streaming regime constrains speech enhancement models to use only a tiny context of future information. As a result, the low-latency streaming setup is generally considered a challenging task and has a significant negative impact on the model's quality. However, the sequential nature of streaming generation offers a natural possibility for autoregression, that is, utilizing previous predictions while making current ones. The conventional method for training autoregressive models is teacher forcing, but its primary drawback lies in the training-inference mismatch that can lead to a substantial degradation in quality. In this study, we propose a straightforward yet effective alternative technique for training autoregressive low-latency speech enhancement models. We demonstrate that the proposed approach leads to stable improvement across diverse architectures and training scenarios.


title: A Comparative Study of Smartphone and Smart TV Apps

abstract: Context: Smart TVs have become one of the most popular television types. Many app developers and service providers have designed TV versions for their smartphone applications. Despite the extensive studies on mobile app analysis, its TV equivalents receive far too little attention. The relationship between phone and TV has not been the subject of research works. Objective: In this paper, we aim to characterize the relationship between smartphone and smart TV apps. To fill this gap, we conduct a comparative study on smartphone and smart TV apps in this work, which is the starting and fundamental step to uncover the domain-specific challenges. Method: We gather a large-scale phone/TV app pairs from Google Play Store. We then analyzed the app pairs quantitatively and qualitatively from a variety of perspectives, including non-code (e.g., metadata, resources, permissions, etc.), code (e.g., components, methods, user interactions, etc.), security and privacy (e.g., reports of AndroBugs and FlowDroid). Results: Our experimental results indicate that (1) the code of the smartphone and TV apps can be released in the same app package or in separate app packages with the same package name; (2) 43% of resource files and 50% of code methods are reused between phone/TV app pairs; (3) TV and phone versions of the same app often encounter different kinds of security vulnerabilities; and (4) TV apps encounter fewer user interactions than their phone versions, but the type of user interaction events, surprisingly, are similar between phone/TV apps. Conclution: Our findings are valuable for developers and academics in comprehending the TV app ecosystem by providing additional insight into the migration of phone apps to TVs and the design mechanism of analysis tools for TV apps.


title: Looking Beyond IoCs: Automatically Extracting Attack Patterns from External CTI

abstract: Public and commercial organizations extensively share cyberthreat intelligence (CTI) to prepare systems to defend against existing and emerging cyberattacks. However, traditional CTI has primarily focused on tracking known threat indicators such as IP addresses and domain names, which may not provide long-term value in defending against evolving attacks. To address this challenge, we propose to use more robust threat intelligence signals called attack patterns. LADDER is a knowledge extraction framework that can extract text-based attack patterns from CTI reports at scale. The framework characterizes attack patterns by capturing the phases of an attack in Android and enterprise networks and systematically maps them to the MITRE ATT\&CK pattern framework. LADDER can be used by security analysts to determine the presence of attack vectors related to existing and emerging threats, enabling them to prepare defenses proactively. We also present several use cases to demonstrate the application of LADDER in real-world scenarios. Finally, we provide a new, open-access benchmark malware dataset to train future cyberthreat intelligence models.


title: Laminar mixed convection in an eccentric annular horizontal duct for a thermodependent non-Newtonian fluid

abstract: The present work focuses on the study of mixed convection of a purely viscous shear-thinning fluid in a horizontal annular eccentric duct. The inner and outer cylinders are heated with constant and uniform heat flux densities. The objective of this work is to study the effect of the variation of eccentricity, rheological behavior of the fluid as well as the thermodependency of the rheological parameters on the reorganization of the flow and thermal stratification caused by the buoyancy forces. At the entrance of the heating zone, the dynamic regime is assumed to be established and the temperature profile uniform. The conservation equations are solved numerically using a finite difference method with implicit schemes. A secondary azimuthal flow, induced by natural convection, develops downstream of the inlet section. This flow creates a stratification of the thermal field on a given section of the duct, which intensifies downstream from the entrance. On the other hand, the decrease in consistency with increasing temperature near the heated walls produces a centrifugal radial flow towards the walls. The presence of an eccentricity induces in turn a significant effect on the main dynamic field and the stratification of the thermal field. Two cases of upward and downward eccentricity are treated. These show that an upward shift increases the stratification of the thermal field, while the stratification begins to weaken from a certain amount of eccentricity in the case of downward shift. This represents an important result in terms of possible industrial applications. We may indeed conclude that an appropriate choice of downward eccentricity can reduce the thermal stratification, observed experimentally in the case of a concentric heated annular duct [1], when this stratification is undesirable. The choice of this eccentricity depends on rheological and thermal properties of the fluid.


title: Gibbs states and their classical limit

abstract: A continuous bundle of $C^*$-algebras provides a rigorous framework to study the thermodynamic limit of quantum theories. If the bundle admits the additional structure of a strict deformation quantization (in the sense of Rieffel) one is allowed to study the classical limit of the quantum system, i.e. a mathematical formalism that examines the convergence of algebraic quantum states to probability measures on phase space (typically a Poisson or symplectic manifold). In this manner we first prove the existence of the classical limit of Gibbs states illustrated with a class of Schr\"{o}dinger operators in the regime where Planck's constant $\hbar$ appearing in front of the Laplacian approaches zero. We additionally show that the ensuing limit corresponds to the unique probability measure satisfying the so-called classical or static KMS- condition. Subsequently, we conduct a similar study on the free energy of mean-field quantum spin systems in the regime of large particles, and discuss the existence of the classical limit of the relevant Gibbs states. Finally, a short section is devoted to single site quantum spin systems in the large spin limit.


title: Speech-based emotion recognition with self-supervised models using attentive channel-wise correlations and label smoothing

abstract: When recognizing emotions from speech, we encounter two common problems: how to optimally capture emotion-relevant information from the speech signal and how to best quantify or categorize the noisy subjective emotion labels. Self-supervised pre-trained representations can robustly capture information from speech enabling state-of-the-art results in many downstream tasks including emotion recognition. However, better ways of aggregating the information across time need to be considered as the relevant emotion information is likely to appear piecewise and not uniformly across the signal. For the labels, we need to take into account that there is a substantial degree of noise that comes from the subjective human annotations. In this paper, we propose a novel approach to attentive pooling based on correlations between the representations' coefficients combined with label smoothing, a method aiming to reduce the confidence of the classifier on the training labels. We evaluate our proposed approach on the benchmark dataset IEMOCAP, and demonstrate high performance surpassing that in the literature. The code to reproduce the results is available at github.com/skakouros/s3prl_attentive_correlation.


title: Learning Decentralized Strategies for a Perimeter Defense Game with Graph Neural Networks

abstract: We consider the problem of finding decentralized strategies for multi-agent perimeter defense games. In this work, we design a graph neural network-based learning framework to learn a mapping from defenders' local perceptions and the communication graph to defenders' actions such that the learned actions are close to that generated by a centralized expert algorithm. We demonstrate that our proposed networks stay closer to the expert policy and are superior to other baseline algorithms by capturing more intruders. Our GNN-based networks are trained at a small scale and can generalize to large scales. To validate our results, we run perimeter defense games in scenarios with different team sizes and initial configurations to evaluate the performance of the learned networks.


title: Optimal Algorithms for Stochastic Complementary Composite Minimization

abstract: Inspired by regularization techniques in statistics and machine learning, we study complementary composite minimization in the stochastic setting. This problem corresponds to the minimization of the sum of a (weakly) smooth function endowed with a stochastic first-order oracle, and a structured uniformly convex (possibly nonsmooth and non-Lipschitz) regularization term. Despite intensive work on closely related settings, prior to our work no complexity bounds for this problem were known. We close this gap by providing novel excess risk bounds, both in expectation and with high probability. Our algorithms are nearly optimal, which we prove via novel lower complexity bounds for this class of problems. We conclude by providing numerical results comparing our methods to the state of the art.


title: Resource-aware Deep Learning for Wireless Fingerprinting Localization

abstract: Location based services, already popular with end users, are now inevitably becoming part of new wireless infrastructures and emerging business processes. The increasingly popular Deep Learning (DL) artificial intelligence methods perform very well in wireless fingerprinting localization based on extensive indoor radio measurement data. However, with the increasing complexity these methods become computationally very intensive and energy hungry, both for their training and subsequent operation. Considering only mobile users, estimated to exceed 7.4 billion by the end of 2025, and assuming that the networks serving these users will need to perform only one localization per user per hour on average, the machine learning models used for the calculation would need to perform $65 \times 10^{12}$ predictions per year. Add to this equation tens of billions of other connected devices and applications that rely heavily on more frequent location updates, and it becomes apparent that localization will contribute significantly to carbon emissions unless more energy-efficient models are developed and used. In this Chapter, we discuss the latest results and trends in wireless localization and look at paths towards achieving more sustainable AI. We then elaborate on a methodology for computing DL model complexity, energy consumption and carbon footprint and show on a concrete example how to develop a more resource-aware model for fingerprinting. We finally compare relevant works in terms of complexity and training CO$_2$ footprint.


title: Holography and magnetohydrodynamics with dynamical gauge fields

abstract: Within the framework of holography, the Einstein-Maxwell action with Dirichlet boundary conditions corresponds to a dual conformal field theory in presence of an external gauge field. Nevertheless, in many real-world applications, e.g., magnetohydrodynamics, plasma physics, superconductors, etc. dynamical gauge fields and Coulomb interactions are fundamental. In this work, we consider bottom-up holographic models at finite magnetic field and (free) charge density in presence of dynamical boundary gauge fields which are introduced using mixed boundary conditions. We numerically study the spectrum of the lowest quasi-normal modes and successfully compare the obtained results to magnetohydrodynamics theory in $2+1$ dimensions. Surprisingly, as far as the electromagnetic coupling is small enough, we find perfect agreement even in the large magnetic field limit. Our results prove that a holographic description of magnetohydrodynamics does not necessarily need higher-form bulk fields but can be consistently derived using mixed boundary conditions for standard gauge fields.


title: PromptEHR: Conditional Electronic Healthcare Records Generation with Prompt Learning

abstract: Accessing longitudinal multimodal Electronic Healthcare Records (EHRs) is challenging due to privacy concerns, which hinders the use of ML for healthcare applications. Synthetic EHRs generation bypasses the need to share sensitive real patient records. However, existing methods generate single-modal EHRs by unconditional generation or by longitudinal inference, which falls short of low flexibility and makes unrealistic EHRs. In this work, we propose to formulate EHRs generation as a text-to-text translation task by language models (LMs), which suffices to highly flexible event imputation during generation. We also design prompt learning to control the generation conditioned by numerical and categorical demographic features. We evaluate synthetic EHRs quality by two perplexity measures accounting for their longitudinal pattern (longitudinal imputation perplexity, lpl) and the connections cross modalities (cross-modality imputation perplexity, mpl). Moreover, we utilize two adversaries: membership and attribute inference attacks for privacy-preserving evaluation. Experiments on MIMIC-III data demonstrate the superiority of our methods on realistic EHRs generation (53.1\% decrease of lpl and 45.3\% decrease of mpl on average compared to the best baselines) with low privacy risks. Software is available at https://github.com/RyanWangZf/PromptEHR.


title: Stock Trading Volume Prediction with Dual-Process Meta-Learning

abstract: Volume prediction is one of the fundamental objectives in the Fintech area, which is helpful for many downstream tasks, e.g., algorithmic trading. Previous methods mostly learn a universal model for different stocks. However, this kind of practice omits the specific characteristics of individual stocks by applying the same set of parameters for different stocks. On the other hand, learning different models for each stock would face data sparsity or cold start problems for many stocks with small capitalization. To take advantage of the data scale and the various characteristics of individual stocks, we propose a dual-process meta-learning method that treats the prediction of each stock as one task under the meta-learning framework. Our method can model the common pattern behind different stocks with a meta-learner, while modeling the specific pattern for each stock across time spans with stock-dependent parameters. Furthermore, we propose to mine the pattern of each stock in the form of a latent variable which is then used for learning the parameters for the prediction module. This makes the prediction procedure aware of the data pattern. Extensive experiments on volume predictions show that our method can improve the performance of various baseline models. Further analyses testify the effectiveness of our proposed meta-learning framework.


title: Implementation of the Digital QS-SVM-based Beamformer on an FPGA Platform

abstract: To address practical challenges in establishing and maintaining robust wireless connectivity such as multi-path effects, low latency, size reduction, and high data rate, the digital beamformer is performed by the hybrid antenna array at the frequency of operation of 10 GHz. The proposed digital beamformer, as a spatial filter, is capable of performing Direction of Arrival (DOA) estimation and beamforming. The most well-established machine learning technique of support vector machine (SVM) for the DoA estimation is limited to problems with linearly-separable datasets. To overcome the aforementioned constraint, in the proposed beamformer, the QS-SVM classifier with a small regularizer has been used for the DoA estimation in addition to the two beamforming techniques of LCMV and MVDR. The QS-SVM-based beamformer has been deployed in an FPGA board, as demonstrated in detail in this work. The implementation results have verified the strong performance of the QS-SVM-based beamformer in suppressing undesired signals, deep nulls with powers less than -10 dB in undesired signals, and transferring desired signals. Furthermore, we have demonstrated that the performance of the QS-SVM-based beamformer consists of other advantages of average latency time in the order of milliseconds, performance efficiency of more than 90\%, and throughput of about 100\%.


title: Ferroelectric response to interlayer shifting and rotations in trilayer hexagonal Boron Nitride

abstract: From monolayers composed of different atoms, we can build structures with spontaneous vertical polarization by conveniently stacking multiple layers. We have studied, using first-principles methods and based on modern polarization theory, a system composed of three layers of hexagonal Boron-Nitride(h-BN) in all possible stackings. We obtain for each of the configurations how charge transfers between the layers and how it impacts on the polarization of the system. In addition, we studied a system of three layers, one of them rotated, and we found that not only did the magnitude of the polarization increase comparing with the bilayer but also, depending on the initial stacking and the rotated layer, we can create a variety of mosaic-like polarization arrangements, which are composed of regions with either triangular or hexagonal symmetry.


title: Functional Determinant Approach Investigations of Heavy Impurity Physics

abstract: In this brief review, we report some new development in the functional determinant approach (FDA), an exact numerical method, in the studies of a heavy quantum impurity immersed in Fermi gases and manipulated with radio-frequency pulses. FDA has been successfully applied to investigate the universal dynamical responses of a heavy impurity in an ultracold ideal Fermi gas in both the time and frequency domain, which allows the exploration of the renowned Anderson's orthogonality catastrophe (OC). In such a system, OC is induced by the multiple particle-hole excitations of the Fermi sea, which is beyond a simple perturbation picture and manifests itself as the absence of quasiparticles named polarons. More recently, two new directions for studying heavy impurity with FDA have been developed. One is to extend FDA to a strongly correlated background superfluid background, a Bardeen-Cooper-Schrieffer (BCS) superfluid. In this system, Anderson's orthogonality catastrophe is prohibited due to the suppression of multiple particle-hole excitations by the superfluid gap, which leads to the existence of genuine polaron. The other direction is to generalize the FDA to the case of multiple RF pulses scheme, which extends the well-established 1D Ramsey spectroscopy in ultracold atoms into multidimensional, in the same spirit as the well-known multidimensional nuclear magnetic resonance and optical multidimensional coherent spectroscopy. Multidimensional Ramsey spectroscopy allows us to investigate correlations between spectral peaks of an impurity-medium system that is not accessible in the conventional one-dimensional spectrum.


title: Scalarization

abstract: Scalarization is a mechanism that endows strongly self-gravitating bodies, such as neutron stars and black holes, with a scalar field configuration. It resembles a phase transition in that the scalar configuration only appears when a certain quantity that characterizes the compact object, e.g., its compactness or spin, is beyond a threshold. We provide a critical and comprehensive review of scalarization, including the mechanism itself, theories that exhibit it, its manifestation in neutron stars, black holes, and their binaries, potential extension to other fields, and a thorough discussion of future perspectives.


title: Redefining Astronomy Summer Camps in the Age of the Pandemic: a Break from the IAYC's 50-Year History

abstract: The International Astronomical Youth Camp (IAYC) is a 50-year old summer camp, where participants work independently on astronomy projects. Due to the ongoing COVID-19 pandemic, the 2020 and 2021 instalments of the IAYC were cancelled, a first in the camp's history. An online format was established dubbed the eIAYC, consisting of three types of activities: (1) an engagement series with astronomical talks and workshops; (2) small independent research projects; and (3) a non-astronomical program involving a range of social activities. Here we present the experience of adapting an in-person camp into an online alternative in order to further the IAYC's mission. We discuss organisational challenges, experiences with online engagement, and how the 2020 eIAYC informed plans for this year's eIAYC.


title: Embedding Knowledge Graph of Patent Metadata to Measure Knowledge Proximity

abstract: Knowledge proximity refers to the strength of association between any two entities in a structural form that embodies certain aspects of a knowledge base. In this work, we operationalize knowledge proximity within the context of the US Patent Database (knowledge base) using a knowledge graph (structural form) named PatNet built using patent metadata, including citations, inventors, assignees, and domain classifications. We train various graph embedding models using PatNet to obtain the embeddings of entities and relations. The cosine similarity between the corresponding (or transformed) embeddings of entities denotes the knowledge proximity between these. We compare the embedding models in terms of their performances in predicting target entities and explaining domain expansion profiles of inventors and assignees. We then apply the embeddings of the best-preferred model to associate homogeneous (e.g., patent-patent) and heterogeneous (e.g., inventor-assignee) pairs of entities.


title: Beyond Schwarzschild-de Sitter spacetimes: I. A new exhaustive class of metrics inspired by Buchdahl for pure $R^2$ gravity in a compact form

abstract: Some sixty years ago Buchdahl pioneered a program in search of static spherically symmetric vacua for pure $R^{2}$ gravity (Nuovo Cimento, Vol 23, No 1, pp 141-157 (1962); [https://link.springer.com/article/10.1007/BF02733549]). Surpassing several obstacles, his work culminated in a non-linear second-order ordinary differential equation (ODE) which required being solved. However Buchdahl deemed the ODE intractable and prematurely abandoned his pursuit for an analytical solution. We have finally managed to break this six-decades-old impasse and accomplish his goal. Reformulating the Buchdahl ODE, we obtain a novel exhaustive class of metrics (which we shall call the Buchdahl-inspired metrics hereafter) in a compact form. We are able to verify ex post, via direct inspection, that the metric obtained herein satisfies the $R^{2}$ vacuo field equation, hence establishing its validity. We show why the Buchdahl-inspired metrics, which exhibit non-constant scalar curvature, defeat a Lichnerowicz-type no-go theorem, previously proved for quadratic gravity, by evading the overly strong restriction on the asymptotic falloff of the metric at spatial infinity. Our novel solution thereby completes Buchdahl's six-decades-old program. We also explore the mathematical properties of the Buchdahl-inspired metrics in the limit of small k and in the region around the coordinate origin.


title: Exploring Explainability Methods for Graph Neural Networks

abstract: With the growing use of deep learning methods, particularly graph neural networks, which encode intricate interconnectedness information, for a variety of real tasks, there is a necessity for explainability in such settings. In this paper, we demonstrate the applicability of popular explainability approaches on Graph Attention Networks (GAT) for a graph-based super-pixel image classification task. We assess the qualitative and quantitative performance of these techniques on three different datasets and describe our findings. The results shed a fresh light on the notion of explainability in GNNs, particularly GATs.


title: The competition between antiferromagnetism and superconductivity in a doped Hubbard model with anisotropic interaction

abstract: The competition between antiferromagnetism and superconductivity is one of the central questions in the research of strong correlated systems. In this work, we utilize a double layer model containing Hubbard interaction and interlayer Heisenberg interaction to reveal their competitions. This model is free of sign problem at certain conditions, and we perform projector quantum Monte Carlo simulations to extract the ground state correlations of magnetism and superconductivity. Our results shows that the superconductivity emerges when the antiferromagnetism is suppressed by tuning the filling or the anisotropy of the interlayer Heisenberg interaction. This model can be seen as an analogue of unconventional superconductors and may help us to understand the transition from an antiferromagnetic insulator to a superconductor.


title: Collaborative Honeypot Defense in UAV Networks: A Learning-Based Game Approach

abstract: The proliferation of unmanned aerial vehicles (UAVs) opens up new opportunities for on-demand service provisioning anywhere and anytime, but also exposes UAVs to a variety of cyber threats. Low/medium interaction honeypots offer a promising lightweight defense for actively protecting mobile Internet of things, particularly UAV networks. While previous research has primarily focused on honeypot system design and attack pattern recognition, the incentive issue for motivating UAV's participation (e.g., sharing trapped attack data in honeypots) to collaboratively resist distributed and sophisticated attacks remains unexplored. This paper proposes a novel game-theoretical collaborative defense approach to address optimal, fair, and feasible incentive design, in the presence of network dynamics and UAVs' multi-dimensional private information (e.g., valid defense data (VDD) volume, communication delay, and UAV cost). Specifically, we first develop a honeypot game between UAVs and the network operator under both partial and complete information asymmetry scenarios. The optimal VDD-reward contract design problem with partial information asymmetry is then solved using a contract-theoretic approach that ensures budget feasibility, truthfulness, fairness, and computational efficiency. In addition, under complete information asymmetry, we devise a distributed reinforcement learning algorithm to dynamically design optimal contracts for distinct types of UAVs in the time-varying UAV network. Extensive simulations demonstrate that the proposed scheme can motivate UAV's cooperation in VDD sharing and improve defensive effectiveness, compared with conventional schemes.


title: Universal optimization efficiency and bounds of Carnot-like heat engines and refrigerators under shortcuts to isothermality

abstract: Based on a quantum thermodynamic protocol for shortcut to isothermality that smoothly modify the system-reservoir interaction can significantly speed up an isothermal process while keeping the overall dissipation constant [Phys. Rev. X. 10, 031015 (2020)], we extend the study of optimization performance of Carnot-like heat engines and refrigerators in a straightforward and unified way. We derive the universal optimization efficiency of heat engines and the optimization coefficient of performance of refrigerators under two unified optimization criterions, i.e., chi criterion and omega criterion. We also derived the universal lower and upper bounds for heat engines and refrigerators, and found that these bounds can be reached under extremely asymmetric cases.


title: Jump-Diffusion Langevin Dynamics for Multimodal Posterior Sampling

abstract: Bayesian methods of sampling from a posterior distribution are becoming increasingly popular due to their ability to precisely display the uncertainty of a model fit. Classical methods based on iterative random sampling and posterior evaluation such as Metropolis-Hastings are known to have desirable long run mixing properties, however are slow to converge. Gradient based methods, such as Langevin Dynamics (and its stochastic gradient counterpart) exhibit favorable dimension-dependence and fast mixing times for log-concave, and "close" to log-concave distributions, however also have long escape times from local minimizers. Many contemporary applications such as Bayesian Neural Networks are both high-dimensional and highly multimodal. In this paper we investigate the performance of a hybrid Metropolis and Langevin sampling method akin to Jump Diffusion on a range of synthetic and real data, indicating that careful calibration of mixing sampling jumps with gradient based chains significantly outperforms both pure gradient-based or sampling based schemes.


title: Two examples concerning existential undecidability in fields

abstract: We construct an existentially undecidable complete discretely valued field of mixed characteristic with existentially decidable residue field and decidable algebraic part, answering a question by Anscombe-Fehm in a strong way. Along the way, we construct an existentially decidable field of positive characteristic with an existentially undecidable finite extension, modifying a construction due to Kesavan Thanagopal.


title: Complexity of Simon's problem in classical sense

abstract: Simon's problem is a standard example of a problem that is exponential in classical sense, while it admits a polynomial solution in quantum computing. It is about a function $f$ for which it is given that a unique non-zero vector $s$ exists for which $f(x) = f(x \oplus s)$ for all $x$, where $\oplus$ is the exclusive or operator. The goal is to find $s$. The exponential lower bound for the classical sense assumes that $f$ only admits black box access. In this paper we investigate classical complexity when $f$ is given by a standard representation like a circuit. We focus on finding the vector space of all vectors $s$ for which $f(x) = f(x \oplus s)$ for all $x$, for any given $f$. Two main results are: (1) if $f$ is given by any circuit, then checking whether this vector space contains a non-zero element is NP-hard, and (2) if $f$ is given by any ordered BDD, then a basis of this vector space can be computed in polynomial time.


title: Evaluating a Synthetic Image Dataset Generated with Stable Diffusion

abstract: We generate synthetic images with the "Stable Diffusion" image generation model using the Wordnet taxonomy and the definitions of concepts it contains. This synthetic image database can be used as training data for data augmentation in machine learning applications, and it is used to investigate the capabilities of the Stable Diffusion model. Analyses show that Stable Diffusion can produce correct images for a large number of concepts, but also a large variety of different representations. The results show differences depending on the test concepts considered and problems with very specific concepts. These evaluations were performed using a vision transformer model for image classification.


title: Progressive Transformation Learning for Leveraging Virtual Images in Training

abstract: To effectively interrogate UAV-based images for detecting objects of interest, such as humans, it is essential to acquire large-scale UAV-based datasets that include human instances with various poses captured from widely varying viewing angles. As a viable alternative to laborious and costly data curation, we introduce Progressive Transformation Learning (PTL), which gradually augments a training dataset by adding transformed virtual images with enhanced realism. Generally, a virtual2real transformation generator in the conditional GAN framework suffers from quality degradation when a large domain gap exists between real and virtual images. To deal with the domain gap, PTL takes a novel approach that progressively iterates the following three steps: 1) select a subset from a pool of virtual images according to the domain gap, 2) transform the selected virtual images to enhance realism, and 3) add the transformed virtual images to the training set while removing them from the pool. In PTL, accurately quantifying the domain gap is critical. To do that, we theoretically demonstrate that the feature representation space of a given object detector can be modeled as a multivariate Gaussian distribution from which the Mahalanobis distance between a virtual object and the Gaussian distribution of each object category in the representation space can be readily computed. Experiments show that PTL results in a substantial performance increase over the baseline, especially in the small data and the cross-domain regime.


title: Exploring explicit coarse-grained structure in artificial neural networks

abstract: We propose to employ the hierarchical coarse-grained structure in the artificial neural networks explicitly to improve the interpretability without degrading performance. The idea has been applied in two situations. One is a neural network called TaylorNet, which aims to approximate the general mapping from input data to output result in terms of Taylor series directly, without resorting to any magic nonlinear activations. The other is a new setup for data distillation, which can perform multi-level abstraction of the input dataset and generate new data that possesses the relevant features of the original dataset and can be used as references for classification. In both cases, the coarse-grained structure plays an important role in simplifying the network and improving both the interpretability and efficiency. The validity has been demonstrated on MNIST and CIFAR-10 datasets. Further improvement and some open questions related are also discussed.

categories: cs.LG cond-mat.stat-mech cond-mat.str-el cs.CV quant-ph


title: Controlling charge density order in 2H-TaSe$_{2}$ using a van Hove singularity

abstract: We report on the interplay between a van Hove singularity and a charge density wave state in 2H-TaSe$_{2}$. We use angle-resolved photoemission spectroscopy to investigate changes in the Fermi surface of this material under surface doping with potassium. At high doping, we observe modifications which imply the disappearance of the $(3\times 3)$ charge density wave and formation of a different correlated state. Using a tight-binding-based approach as well as an effective model, we explain our observations as a consequence of coupling between the single-particle Lifshitz transition during which the Fermi level passes a van Hove singularity and the charge density order. In this scenario, the high electronic density of states associated with the van Hove singularity induces a change in the periodicity of the charge density wave from the known $(3\times 3)$ to a new $(2\times 2)$ superlattice.


title: Video Event Extraction via Tracking Visual States of Arguments

abstract: Video event extraction aims to detect salient events from a video and identify the arguments for each event as well as their semantic roles. Existing methods focus on capturing the overall visual scene of each frame, ignoring fine-grained argument-level information. Inspired by the definition of events as changes of states, we propose a novel framework to detect video events by tracking the changes in the visual states of all involved arguments, which are expected to provide the most informative evidence for the extraction of video events. In order to capture the visual state changes of arguments, we decompose them into changes in pixels within objects, displacements of objects, and interactions among multiple arguments. We further propose Object State Embedding, Object Motion-aware Embedding and Argument Interaction Embedding to encode and track these changes respectively. Experiments on various video event extraction tasks demonstrate significant improvements compared to state-of-the-art models. In particular, on verb classification, we achieve 3.49% absolute gains (19.53% relative gains) in F1@5 on Video Situation Recognition.


title: A logical analysis of fixpoint theorems

abstract: We prove a fixpoint theorem for contractions on Cauchy-complete quantale-enriched categories. It holds for any quantale whose underlying lattice is continuous, and applies to contractions whose control function is sequentially lower-semicontinuous. Sufficient conditions for the uniqueness of the fixpoint are established. Examples include known and new fixpoint theorems for metric spaces, fuzzy metric spaces, and probabilistic metric spaces.


title: Quantifying and Learning Static vs. Dynamic Information in Deep Spatiotemporal Networks

abstract: There is limited understanding of the information captured by deep spatiotemporal models in their intermediate representations. For example, while evidence suggests that action recognition algorithms are heavily influenced by visual appearance in single frames, no quantitative methodology exists for evaluating such static bias in the latent representation compared to bias toward dynamics. We tackle this challenge by proposing an approach for quantifying the static and dynamic biases of any spatiotemporal model, and apply our approach to three tasks, action recognition, automatic video object segmentation (AVOS) and video instance segmentation (VIS). Our key findings are: (i) Most examined models are biased toward static information. (ii) Some datasets that are assumed to be biased toward dynamics are actually biased toward static information. (iii) Individual channels in an architecture can be biased toward static, dynamic or a combination of the two. (iv) Most models converge to their culminating biases in the first half of training. We then explore how these biases affect performance on dynamically biased datasets. For action recognition, we propose StaticDropout, a semantically guided dropout that debiases a model from static information toward dynamics. For AVOS, we design a better combination of fusion and cross connection layers compared with previous architectures.


title: MALUNet: A Multi-Attention and Light-weight UNet for Skin Lesion Segmentation

abstract: Recently, some pioneering works have preferred applying more complex modules to improve segmentation performances. However, it is not friendly for actual clinical environments due to limited computing resources. To address this challenge, we propose a light-weight model to achieve competitive performances for skin lesion segmentation at the lowest cost of parameters and computational complexity so far. Briefly, we propose four modules: (1) DGA consists of dilated convolution and gated attention mechanisms to extract global and local feature information; (2) IEA, which is based on external attention to characterize the overall datasets and enhance the connection between samples; (3) CAB is composed of 1D convolution and fully connected layers to perform a global and local fusion of multi-stage features to generate attention maps at channel axis; (4) SAB, which operates on multi-stage features by a shared 2D convolution to generate attention maps at spatial axis. We combine four modules with our U-shape architecture and obtain a light-weight medical image segmentation model dubbed as MALUNet. Compared with UNet, our model improves the mIoU and DSC metrics by 2.39% and 1.49%, respectively, with a 44x and 166x reduction in the number of parameters and computational complexity. In addition, we conduct comparison experiments on two skin lesion segmentation datasets (ISIC2017 and ISIC2018). Experimental results show that our model achieves state-of-the-art in balancing the number of parameters, computational complexity and segmentation performances. Code is available at https://github.com/JCruan519/MALUNet.