title: Efficient List-Decodable Regression using Batches

abstract: We begin the study of list-decodable linear regression using batches. In this setting only an $\alpha \in (0,1]$ fraction of the batches are genuine. Each genuine batch contains $\ge n$ i.i.d. samples from a common unknown distribution and the remaining batches may contain arbitrary or even adversarial samples. We derive a polynomial time algorithm that for any $n\ge \tilde \Omega(1/\alpha)$ returns a list of size $\mathcal O(1/\alpha^2)$ such that one of the items in the list is close to the true regression parameter. The algorithm requires only $\tilde{\mathcal{O}}(d/\alpha^2)$ genuine batches and works under fairly general assumptions on the distribution. The results demonstrate the utility of batch structure, which allows for the first polynomial time algorithm for list-decodable regression, which may be impossible for the non-batch setting, as suggested by a recent SQ lower bound \cite{diakonikolas2021statistical} for the non-batch setting.


title: Towards Advanced Monitoring for Scientific Workflows

abstract: Scientific workflows consist of thousands of highly parallelized tasks executed in a distributed environment involving many components. Automatic tracing and investigation of the components' and tasks' performance metrics, traces, and behavior are necessary to support the end user with a level of abstraction since the large amount of data cannot be analyzed manually. The execution and monitoring of scientific workflows involves many components, the cluster infrastructure, its resource manager, the workflow, and the workflow tasks. All components in such an execution environment access different monitoring metrics and provide metrics on different abstraction levels. The combination and analysis of observed metrics from different components and their interdependencies are still widely unregarded. We specify four different monitoring layers that can serve as an architectural blueprint for the monitoring responsibilities and the interactions of components in the scientific workflow execution context. We describe the different monitoring metrics subject to the four layers and how the layers interact. Finally, we examine five state-of-the-art scientific workflow management systems (SWMS) in order to assess which steps are needed to enable our four-layer-based approach.


title: Unresolved Binaries and Multiples in the Intermediate Mass Range in open clusters: Pleiades, Alpha Per, Praesepe, and NGC 1039

abstract: In this study, we continue our project to search for unresolved binary and multiple systems in open clusters exploiting the photometric diagram (H-W2)-W1 vs W2-(BP-K) firstly introduced in \citet{Malofeeva+2022}. In particular, here we estimate the binary and multiple star ratios and the distribution of the component mass ratio $q$ in the Galactic clusters Alpha Persei, Praesepe, and NGC 1039. We have modified the procedure outlined in our first study \citep{Malofeeva+2022} making star counts automatic and by introducing bootstrapping for error estimation. Basing on this, we re-investigated the Pleiades star cluster in the same mass range as in our previous work and corrected an inaccuracy in the mass ratio $q$ distribution. The binary and multiple star ratio in the four clusters is then found to lie between 0.45$\pm$0.03 and 0.73$\pm$0.03. On the other hand, the ratio of systems with multiplicity more than 2 is between 0.06$\pm$0.01 and 0.09$\pm$0.02. The distribution of the component mass ratio $q$ is well fitted with a Gaussian having the mode between 0.22$\pm$0.04 and 0.52$\pm$0.01 and the dispersion between 0.10$\pm$0.02 and 0.35$\pm$0.07. All clusters show a large number of the very low-mass secondary components in the binary systems with primary components below 0.5 $M_{\odot}$.


title: Completing point cloud from few points by Wasserstein GAN and Transformers

abstract: In many vision and robotics applications, it is common that the captured objects are represented by very few points. Most of the existing completion methods are designed for partial point clouds with many points, and they perform poorly or even fail completely in the case of few points. However, due to the lack of detail information, completing objects from few points faces a huge challenge. Inspired by the successful applications of GAN and Transformers in the image-based vision task, we introduce GAN and Transformer techniques to address the above problem. Firstly, the end-to-end encoder-decoder network with Transformers and the Wasserstein GAN with Transformer are pre-trained, and then the overall network is fine-tuned. Experimental results on the ShapeNet dataset show that our method can not only improve the completion performance for many input points, but also keep stable for few input points. Our source code is available at https://github.com/WxfQjh/Stability-point-recovery.git.


title: Beyond the broken tetrahedron

abstract: Here we consider the hypergraph Tur\'an problem in uniformly dense hypergraphs as was suggested by Erd\H{o}s and S\'os. Given a $3$-graph $F$, the uniform Tur\'an density $\pi_u(F)$ of $F$ is defined as the supremum over all $d\in[0,1]$ for which there is an $F$-free uniformly $d$-dense $3$-graph, where uniformly $d$-dense means that every linearly sized subhypergraph has density at least $d$. Recently, Glebov, Kr\'al', and Volec and, independently, Reiher, R\"odl, and Schacht proved that $\pi_u(K_4^{(3)-})=\frac{1}{4}$, solving a conjecture by Erd\H{o}s and S\'os. Reiher, R\"odl, and Schacht also characterised all $3$-graphs with $\pi_u(F)=0$. Very recently, Buci\'c, Cooper, Kr\'al', Mohr, and Correira determined the uniform Tur\'an density of $3$-uniform tight cycles (of length at least $5$), answering a question by Reiher. These hypergraphs and their blow-ups are the only hypergraphs for which the uniform Tur\'an density is known. In this work, we determine the uniform Tur\'an density of the $3$-graph on five vertices that is obtained from $K_4^{(3)-}$ by adding an additional vertex whose link forms a matching on the vertices of $K_4^{(3)-}$. Further, we point to two natural intermediate problems on the way to determining $\pi_u(K_4^{(3)})$ and solve the first of these.


title: Dynamic Appearance: A Video Representation for Action Recognition with Joint Training

abstract: Static appearance of video may impede the ability of a deep neural network to learn motion-relevant features in video action recognition. In this paper, we introduce a new concept, Dynamic Appearance (DA), summarizing the appearance information relating to movement in a video while filtering out the static information considered unrelated to motion. We consider distilling the dynamic appearance from raw video data as a means of efficient video understanding. To this end, we propose the Pixel-Wise Temporal Projection (PWTP), which projects the static appearance of a video into a subspace within its original vector space, while the dynamic appearance is encoded in the projection residual describing a special motion pattern. Moreover, we integrate the PWTP module with a CNN or Transformer into an end-to-end training framework, which is optimized by utilizing multi-objective optimization algorithms. We provide extensive experimental results on four action recognition benchmarks: Kinetics400, Something-Something V1, UCF101 and HMDB51.


title: Galaxy and Mass Assembly (GAMA): Extended Intra-Group Light in a group at $z=0.2$ from deep Hyper-Suprime Cam images

abstract: We present a pilot study to assess the potential of Hyper Suprime-Cam Public Data Release 2 (HSC-PDR2) images for the analysis of extended faint structures within groups of galaxies. We examine the intra-group light (IGL) of the group 400138 ($M_{\rm{dyn}}= 1.3 \pm 0.5 \times 10^{13} $M$_{\odot}$, $z\sim 0.2$) from the Galaxy And Mass Assembly (GAMA) survey using Hyper-Suprime Cam Subaru Strategic Program Public Data Release 2 (HSC-PDR2) images in $g$, $r$, and $i$ bands. We present the most extended IGL measurement to date, reaching down to $\mu_{g}^{\rm{lim}}=30.76$ mag arcsec$^{-2}$ ($3 \sigma$; $10 \times 10$ arcsec$^{2}$) at a semi-major axis of 275 kpc. The IGL shows mean colour values of $g-i=0.92$, $g-r=0.60$, and $r-i=0.32$ ($\pm$0.01). The IGL stellar populations are younger ($2-2.5$ Gyr) and less metal-rich ([Fe/H] $ \sim -$0.4) than those of the host group galaxies. We find a range of IGL fractions as a function of total group luminosity of $\sim 2-36 \%$ depending on the definition of IGL, with larger fractions the bluer the observation wavelength. The early-type to late-type galaxy ratio suggests that 400138 is a more evolved group, dominated by ETGs, and the IGL fraction agrees with that of other similarly evolved groups. These results are consistent with tidal stripping of the outer parts of Milky Way-like galaxies as the main driver of the IGL build-up. This is supported by the detection of substructure in the IGL towards the galaxy member 1660615 suggesting a recent interaction ($<1$ Gyr ago) of that galaxy with the core of the group.


title: Weighted exchange distance of basis pairs

abstract: Two pairs of disjoint bases $\mathbf{P}_1=(R_1,B_1)$ and $\mathbf{P}_2=(R_2,B_2)$ of a matroid $M$ are called equivalent if $\mathbf{P}_1$ can be transformed into $\mathbf{P}_2$ by a series of symmetric exchanges. In 1980, White conjectured that such a sequence always exists whenever $R_1\cup B_1=R_2\cup B_2$. A strengthening of the conjecture was proposed by Hamidoune, stating that minimum length of an exchange is at most the rank of the matroid. We propose a weighted variant of Hamidoune's conjecture, where the weight of an exchange depends on the weights of the exchanged elements. We prove the conjecture for several matroid classes: strongly base orderable matroids, split matroids, graphic matroids of wheels, and spikes.


title: SAH: Shifting-aware Asymmetric Hashing for Reverse $k$-Maximum Inner Product Search

abstract: This paper investigates a new yet challenging problem called Reverse $k$-Maximum Inner Product Search (R$k$MIPS). Given a query (item) vector, a set of item vectors, and a set of user vectors, the problem of R$k$MIPS aims to find a set of user vectors whose inner products with the query vector are one of the $k$ largest among the query and item vectors. We propose the first subquadratic-time algorithm, i.e., Shifting-aware Asymmetric Hashing (SAH), to tackle the R$k$MIPS problem. To speed up the Maximum Inner Product Search (MIPS) on item vectors, we design a shifting-invariant asymmetric transformation and develop a novel sublinear-time Shifting-Aware Asymmetric Locality Sensitive Hashing (SA-ALSH) scheme. Furthermore, we devise a new blocking strategy based on the Cone-Tree to effectively prune user vectors (in a batch). We prove that SAH achieves a theoretical guarantee for solving the RMIPS problem. Experimental results on five real-world datasets show that SAH runs 4$\sim$8$\times$ faster than the state-of-the-art methods for R$k$MIPS while achieving F1-scores of over 90\%. The code is available at \url{https://github.com/HuangQiang/SAH}.


title: Agent-Specific Deontic Modality Detection in Legal Language

abstract: Legal documents are typically long and written in legalese, which makes it particularly difficult for laypeople to understand their rights and duties. While natural language understanding technologies can be valuable in supporting such understanding in the legal domain, the limited availability of datasets annotated for deontic modalities in the legal domain, due to the cost of hiring experts and privacy issues, is a bottleneck. To this end, we introduce, LEXDEMOD, a corpus of English contracts annotated with deontic modality expressed with respect to a contracting party or agent along with the modal triggers. We benchmark this dataset on two tasks: (i) agent-specific multi-label deontic modality classification, and (ii) agent-specific deontic modality and trigger span detection using Transformer-based (Vaswani et al., 2017) language models. Transfer learning experiments show that the linguistic diversity of modal expressions in LEXDEMOD generalizes reasonably from lease to employment and rental agreements. A small case study indicates that a model trained on LEXDEMOD can detect red flags with high recall. We believe our work offers a new research direction for deontic modality detection in the legal domain.


title: Approximation hierarchies for copositive cone over symmetric cone and their comparison

abstract: We first provide an inner-approximation hierarchy described by a sum-of-squares (SOS) constraint for the copositive (COP) cone over a general symmetric cone. The hierarchy is a generalization of that proposed by Parrilo (2000) for the usual COP cone (over a nonnegative orthant). We also discuss its dual. Second, we characterize the COP cone over a symmetric cone using the usual COP cone. By replacing the usual COP cone appearing in this characterization with the inner- or outer-approximation hierarchy provided by de Klerk and Pasechnik (2002) or Yildirim (2012), we obtain an inner- or outer-approximation hierarchy described by semidefinite but not by SOS constraints for the COP matrix cone over the direct product of a nonnegative orthant and a second-order cone. We then compare them with the existing hierarchies provided by Zuluaga et al. (2006) and Lasserre (2014). Theoretical and numerical examinations imply that we can numerically increase a depth parameter, which determines an approximation accuracy, in the approximation hierarchies derived from de Klerk and Pasechnik (2002) and Yildirim (2012), particularly when the nonnegative orthant is small. In such a case, the approximation hierarchy derived from Yildirim (2012) can yield nearly optimal values numerically. Combining the proposed approximation hierarchies with existing ones, we can evaluate the optimal value of COP programming problems more accurately and efficiently.


title: Resonant friction on discs in galactic nuclei

abstract: We argue that resonant friction has a dramatic effect on a disc whose rotation direction is misaligned with that of its host nuclear star cluster. The disc's gravity causes gravitational perturbation of the cluster that in turn exerts a strong torque back onto the disc. We argue that this torque may be responsible for the observed disruption of the clockwise disc of young stars in the Galactic Center, and show in numerical experiments that it produces the observed features in the distribution of the stars' angular momenta. More generally, we speculate that the rotation of nuclear star clusters has a stabilizing effect on the orientation of transient massive accretion discs around the supermassive black holes residing in their centers, and thus on the directions and magnitudes of the black-hole spins.


title: A Girsanov-type formula for a class of anticipative transforms of Brownian motion associated with exponential functionals

abstract: In this paper, with the help of a result by Matsumoto--Yor (2000), we prove a Girsanov-type formula for a class of anticipative transforms of Brownian motion which possesses exponential functionals as anticipating factors. Our result unifies existing formulas in earlier works. As an application, we also consider the law of Brownian motion perturbed by a positive weight of a fairly wide class, and prove its invariance under an anticipative transformation associated with the perturbation. In the course of our exploration, a disintegration formula for the Wiener measure related to exponential functionals plays a key role.


title: Interferometric imaging of the type IIIb and U radio bursts observed with LOFAR on 22 August 2017

abstract: The Sun is the source of different types of radio bursts that are associated with solar flares, for example. Among the most frequently observed phenomena are type III solar bursts. Their radio images at low frequencies (below 100 MHz) are relatively poorly studied due to the limitations of legacy radio telescopes. We study the general characteristics of types IIIb and U with stria structure solar radio bursts in the frequency range of 20 - 80 MHz, in particular the source size and evolution in different altitudes, as well as the velocity and energy of electron beams responsible for their generation. In this work types IIIb and U with stria structure radio bursts are analyzed using data from the LOFAR telescope including dynamic spectra and imaging observations, as well as data taken in the X-ray range (GOES and RHESSI satellites) and in the extreme ultraviolet (SDO satellite). In this study we determined the source size limited by the actual shape of the contour at particular frequencies of type IIIb and U solar bursts in a relatively wide frequency band from 20 to 80 MHz. Two of the bursts seem to appear at roughly the same place in the studied active region and their source sizes are similar. It is different in the case of another burst, which seems to be related to another part of the magnetic field structure in this active region. The velocities of the electron beams responsible for the generation of the three bursts studied here were also found to be different.


title: FAIRification of MLC data

abstract: The multi-label classification (MLC) task has increasingly been receiving interest from the machine learning (ML) community, as evidenced by the growing number of papers and methods that appear in the literature. Hence, ensuring proper, correct, robust, and trustworthy benchmarking is of utmost importance for the further development of the field. We believe that this can be achieved by adhering to the recently emerged data management standards, such as the FAIR (Findable, Accessible, Interoperable, and Reusable) and TRUST (Transparency, Responsibility, User focus, Sustainability, and Technology) principles. To FAIRify the MLC datasets, we introduce an ontology-based online catalogue of MLC datasets that follow these principles. The catalogue extensively describes many MLC datasets with comprehensible meta-features, MLC-specific semantic descriptions, and different data provenance information. The MLC data catalogue is extensively described in our recent publication in Nature Scientific Reports, Kostovska & Bogatinovski et al., and available at: http://semantichub.ijs.si/MLCdatasets. In addition, we provide an ontology-based system for easy access and querying of performance/benchmark data obtained from a comprehensive MLC benchmark study. The system is available at: http://semantichub.ijs.si/MLCbenchmark.


title: PANeRF: Pseudo-view Augmentation for Improved Neural Radiance Fields Based on Few-shot Inputs

abstract: The method of neural radiance fields (NeRF) has been developed in recent years, and this technology has promising applications for synthesizing novel views of complex scenes. However, NeRF requires dense input views, typically numbering in the hundreds, for generating high-quality images. With a decrease in the number of input views, the rendering quality of NeRF for unseen viewpoints tends to degenerate drastically. To overcome this challenge, we propose pseudo-view augmentation of NeRF, a scheme that expands a sufficient amount of data by considering the geometry of few-shot inputs. We first initialized the NeRF network by leveraging the expanded pseudo-views, which efficiently minimizes uncertainty when rendering unseen views. Subsequently, we fine-tuned the network by utilizing sparse-view inputs containing precise geometry and color information. Through experiments under various settings, we verified that our model faithfully synthesizes novel-view images of superior quality and outperforms existing methods for multi-view datasets.


title: NAS-LID: Efficient Neural Architecture Search with Local Intrinsic Dimension

abstract: One-shot neural architecture search (NAS) substantially improves the search efficiency by training one supernet to estimate the performance of every possible child architecture (i.e., subnet). However, the inconsistency of characteristics among subnets incurs serious interference in the optimization, resulting in poor performance ranking correlation of subnets. Subsequent explorations decompose supernet weights via a particular criterion, e.g., gradient matching, to reduce the interference; yet they suffer from huge computational cost and low space separability. In this work, we propose a lightweight and effective local intrinsic dimension (LID)-based method NAS-LID. NAS-LID evaluates the geometrical properties of architectures by calculating the low-cost LID features layer-by-layer, and the similarity characterized by LID enjoys better separability compared with gradients, which thus effectively reduces the interference among subnets. Extensive experiments on NASBench-201 indicate that NAS-LID achieves superior performance with better efficiency. Specifically, compared to the gradient-driven method, NAS-LID can save up to 86% of GPU memory overhead when searching on NASBench-201. We also demonstrate the effectiveness of NAS-LID on ProxylessNAS and OFA spaces. Source code: https://github.com/marsggbo/NAS-LID.


title: InDiReCT: Language-Guided Zero-Shot Deep Metric Learning for Images

abstract: Common Deep Metric Learning (DML) datasets specify only one notion of similarity, e.g., two images in the Cars196 dataset are deemed similar if they show the same car model. We argue that depending on the application, users of image retrieval systems have different and changing similarity notions that should be incorporated as easily as possible. Therefore, we present Language-Guided Zero-Shot Deep Metric Learning (LanZ-DML) as a new DML setting in which users control the properties that should be important for image representations without training data by only using natural language. To this end, we propose InDiReCT (Image representations using Dimensionality Reduction on CLIP embedded Texts), a model for LanZ-DML on images that exclusively uses a few text prompts for training. InDiReCT utilizes CLIP as a fixed feature extractor for images and texts and transfers the variation in text prompt embeddings to the image embedding space. Extensive experiments on five datasets and overall thirteen similarity notions show that, despite not seeing any images during training, InDiReCT performs better than strong baselines and approaches the performance of fully-supervised models. An analysis reveals that InDiReCT learns to focus on regions of the image that correlate with the desired similarity notion, which makes it a fast to train and easy to use method to create custom embedding spaces only using natural language.


title: MPMICE: A hybrid MPM-CFD model for simulating coupled problems in porous media. Application to earthquake-induced submarine landslides

abstract: In this paper, we describe a soil-fluid-structure interaction model that combines soil mechanics (saturated sediments), fluid mechanics (seawater or air), and solid mechanics (structures). The formulation combines the Material Point Method, which models large deformation of the porous media and the structure, with the Implicit Continuous-fluid Eulerian, which models complex fluid flows. We validate the model and simulate the whole process of earthquake-induced submarine landslides. We show that this model captures complex interactions between saturated sediment, seawater, and structure, so we can use the model to estimate the impact of potential submarine landslides on offshore structures.


title: Non-Hermitian Mode Cleaning in Periodically Modulated Multimode Fibers

abstract: We show that the simultaneous modulation of the propagation constant and of the gain/loss coefficient along the multimode fibers results in unidirectional coupling among the modes, which, depending on the modulation parameters, leads to the enhancement or reduction of the excitation of higher order transverse modes. In the latter case, effective mode-cleaning is predicted, in ideal case resulting in single-mode spatially coherent output. The effect is semi-analytically predicted on a simplified Gaussian beam approximation and numerically proven by solving the wave propagation equation introducing the modulated potential.


title: Inductive algebras for compact groups

abstract: Inductive algebras for a compact group are self-adjoint


title: VoP: Text-Video Co-operative Prompt Tuning for Cross-Modal Retrieval

abstract: Many recent studies leverage the pre-trained CLIP for text-video cross-modal retrieval by tuning the backbone with additional heavy modules, which not only brings huge computational burdens with much more parameters, but also leads to the knowledge forgetting from upstream models. In this work, we propose the VoP: Text-Video Co-operative Prompt Tuning for efficient tuning on the text-video retrieval task. The proposed VoP is an end-to-end framework with both video & text prompts introducing, which can be regarded as a powerful baseline with only 0.1% trainable parameters. Further, based on the spatio-temporal characteristics of videos, we develop three novel video prompt mechanisms to improve the performance with different scales of trainable parameters. The basic idea of the VoP enhancement is to model the frame position, frame context, and layer function with specific trainable prompts, respectively. Extensive experiments show that compared to full fine-tuning, the enhanced VoP achieves a 1.4% average R@1 gain across five text-video retrieval benchmarks with 6x less parameter overhead. The code will be available at https://github.com/bighuang624/VoP.


title: Analysis of Discrete-Time Switched Linear Systems under Logic Dynamic Switchings

abstract: The control properties of discrete-time switched linear systems (SLS) with switching signals generated by logical dynamic systems are studied using the semi-tensor product (STP) approach. With the algebraic state space representation (ASSR), the linear modes and the logical generators are aggregated as a hybrid system, leading to the criteria of reachability, controllability, observability, and reconstructibility of the SLSs. Algorithms for checking these properties are given. Then, two kinds of realization problems concerning whether the logical dynamic systems can generate the desired switching signals are investigated, and necessary and sufficient conditions for the realisability of the required switching signals are given with respect to the cases of fixed operating time switching and finite reference signal switching.


title: One-loop tensor power spectrum from an excited scalar field during inflation

abstract: We present a consistent one-loop calculation for the inflationary tensor power spectrum in the presence of an excited spectator scalar field using the in-in formalism. We find that the super-horizon primordial power spectrum of the tensor mode can be scale-invariantly enhanced or reduced by the loop effects of a subhorizon scalar field. Our calculation also includes the scalar-induced gravitational wave spectrum classically computed in the previous literature, which is significant only near the scales where the scalar field is amplified. The super-horizon enhancement is a higher-order effect of the interaction Hamiltonian, which can be understood as a Bogoliubov transformation introduced by nonlinear interactions. On the other hand, the scale-invariant reduction of the tensor power spectrum may occur due to the fourth-order scalar-scalar-tensor-tensor coupling. This phenomenon can be understood as the evolution of an anisotropic Bianchi type-I background in the separate universe approach. Our result suggests that large-scale measurements may indirectly test the dramatic effects of small-scale cosmological perturbations through loop corrections. This possibility opens a new ground in probing the small-scale physics of the primordial Universe through gravitational wave detectors of cosmological scales.


title: Cambrian Explosion Algorithm for Multi-Objective Association Rules Mining

abstract: Association rule mining is one of the most studied research fields of data mining, with applications ranging from grocery basket problems to highly explainable classification systems. Classical association rule mining algorithms have several flaws especially with regards to their execution times, memory usage and number of rules produced. An alternative is the use of meta-heuristics, which have been used on several optimisation problems. This paper has two objectives. First, we provide a comparison of the performances of state-of-the-art meta-heuristics on the association rule mining problem. We use the multi-objective versions of those algorithms using support, confidence and cosine. Second, we propose a new algorithm designed to mine rules efficiently from massive datasets by exploring a large variety of solutions, akin to the explosion of species diversity of the Cambrian Explosion. We compare our algorithm to 20 benchmark algorithms on 22 real-world data-sets, and show that our algorithm present good results and outperform several state-of-the-art algorithms.


title: Mean-field phase transitions in TGFT quantum gravity

abstract: Controlling the continuum limit and extracting effective gravitational physics are shared challenges for quantum gravity approaches based on quantum discrete structures. The description of quantum gravity in terms of tensorial group field theory (TGFT) has recently led to much progress in its application to phenomenology, in particular cosmology. This application relies on the assumption of a phase transition to a nontrivial vacuum (condensate) state describable by mean-field theory, an assumption that is difficult to corroborate by a full renormalization group flow analysis due to the complexity of the relevant TGFT models. Here we demonstrate that this assumption is justified due to the specific ingredients of realistic quantum geometric TGFT models: combinatorially non-local interactions, matter degrees of freedom and Lorentz group data together with the encoding of micro-causality. This greatly strengthens the evidence for the existence of a meaningful continuum gravitational regime in group-field and spin-foam quantum gravity, the phenomenology of which is amenable to explicit computations in a mean-field approximation.


title: Byzantine Multiple Access Channels -- Part I: Reliable Communication

abstract: We study communication over a Multiple Access Channel (MAC) where users can possibly be adversarial. The receiver is unaware of the identity of the adversarial users (if any). When all users are non-adversarial, we want their messages to be decoded reliably. When a user behaves adversarially, we require that the honest users' messages be decoded reliably. An adversarial user can mount an attack by sending any input into the channel rather than following the protocol. It turns out that the $2$-user MAC capacity region follows from the point-to-point Arbitrarily Varying Channel (AVC) capacity. For the $3$-user MAC in which at most one user may be malicious, we characterize the capacity region for deterministic codes and randomized codes (where each user shares an independent random secret key with the receiver). These results are then generalized for the $k$-user MAC where the adversary may control all users in one out of a collection of given subsets.


title: Interpretability of an Interaction Network for identifying $H \rightarrow b\bar{b}$ jets

abstract: Multivariate techniques and machine learning models have found numerous applications in High Energy Physics (HEP) research over many years. In recent times, AI models based on deep neural networks are becoming increasingly popular for many of these applications. However, neural networks are regarded as black boxes -- because of their high degree of complexity it is often quite difficult to quantitatively explain the output of a neural network by establishing a tractable input-output relationship and information propagation through the deep network layers. As explainable AI (xAI) methods are becoming more popular in recent years, we explore interpretability of AI models by examining an Interaction Network (IN) model designed to identify boosted $H\to b\bar{b}$ jets amid QCD background. We explore different quantitative methods to demonstrate how the classifier network makes its decision based on the inputs and how this information can be harnessed to reoptimize the model-making it simpler yet equally effective. We additionally illustrate the activity of hidden layers within the IN model as Neural Activation Pattern (NAP) diagrams. Our experiments suggest NAP diagrams reveal important information about how information is conveyed across the hidden layers of deep model. These insights can be useful to effective model reoptimization and hyperparameter tuning.


title: Reconnoitering the class distinguishing abilities of the features, to know them better

abstract: The relevance of machine learning (ML) in our daily lives is closely intertwined with its explainability. Explainability can allow end-users to have a transparent and humane reckoning of a ML scheme's capability and utility. It will also foster the user's confidence in the automated decisions of a system. Explaining the variables or features to explain a model's decision is a need of the present times. We could not really find any work, which explains the features on the basis of their class-distinguishing abilities (specially when the real world data are mostly of multi-class nature). In any given dataset, a feature is not equally good at making distinctions between the different possible categorizations (or classes) of the data points. In this work, we explain the features on the basis of their class or category-distinguishing capabilities. We particularly estimate the class-distinguishing capabilities (scores) of the variables for pair-wise class combinations. We validate the explainability given by our scheme empirically on several real-world, multi-class datasets. We further utilize the class-distinguishing scores in a latent feature context and propose a novel decision making protocol. Another novelty of this work lies with a \emph{refuse to render decision} option when the latent variable (of the test point) has a high class-distinguishing potential for the likely classes.


title: Drop impact on superheated surfaces: from capillary dominance to non-linear advection dominance

abstract: Ambient air cushions the impact of drops on solid substrates, an effect usually revealed by the entrainment of a bubble, trapped as the air squeezed under the drop drains and liquid-solid contact occurs. The presence of air becomes evident for impacts on very smooth surfaces, where the gas film can be sustained, allowing drops to bounce without wetting the substrate. In such a non-wetting situation, Mandre & Brenner (2012) numerically and theoretically evidenced that two physical mechanisms can act to prevent contact: surface tension and non-linear advection. However, the advection dominated regime has remained hidden in experiments as liquid-solid contact prevents to realize rebounds at sufficiently large impact velocities. By performing impacts on superheated surfaces, in the so-called dynamical Leidenfrost regime Tran et al. (2012), we enable drop rebound at higher impact velocities, allowing us to reveal this regime. Using high-speed total internal reflection, we measure the minimal gas film thickness under impacting drops, and provide evidence for the transition from the surface tension to the non-linear inertia dominated regime. We rationalise our measurements through scaling relationships derived by coupling the liquid and gas dynamics, in the presence of evaporation.


title: Learning Regularized Positional Encoding for Molecular Prediction

abstract: Machine learning has become a promising approach for molecular modeling. Positional quantities, such as interatomic distances and bond angles, play a crucial role in molecule physics. The existing works rely on careful manual design of their representation. To model the complex nonlinearity in predicting molecular properties in an more end-to-end approach, we propose to encode the positional quantities with a learnable embedding that is continuous and differentiable. A regularization technique is employed to encourage embedding smoothness along the physical dimension. We experiment with a variety of molecular property and force field prediction tasks. Improved performance is observed for three different model architectures after plugging in the proposed positional encoding method. In addition, the learned positional encoding allows easier physics-based interpretation. We observe that tasks of similar physics have the similar learned positional encoding.


title: Prototypical context-aware dynamics generalization for high-dimensional model-based reinforcement learning

abstract: The latent world model provides a promising way to learn policies in a compact latent space for tasks with high-dimensional observations, however, its generalization across diverse environments with unseen dynamics remains challenging. Although the recurrent structure utilized in current advances helps to capture local dynamics, modeling only state transitions without an explicit understanding of environmental context limits the generalization ability of the dynamics model. To address this issue, we propose a Prototypical Context-Aware Dynamics (ProtoCAD) model, which captures the local dynamics by time consistent latent context and enables dynamics generalization in high-dimensional control tasks. ProtoCAD extracts useful contextual information with the help of the prototypes clustered over batch and benefits model-based RL in two folds: 1) It utilizes a temporally consistent prototypical regularizer that encourages the prototype assignments produced for different time parts of the same latent trajectory to be temporally consistent instead of comparing the features; 2) A context representation is designed which combines both the projection embedding of latent states and aggregated prototypes and can significantly improve the dynamics generalization ability. Extensive experiments show that ProtoCAD surpasses existing methods in terms of dynamics generalization. Compared with the recurrent-based model RSSM, ProtoCAD delivers 13.2% and 26.7% better mean and median performance across all dynamics generalization tasks.


title: Benchmarking Variational Quantum Eigensolvers for Quantum Chemistry

abstract: Quantum chemistry is one of the most promising applications of quantum computers in the near future. For noisy intermediate-scale quantum devices, the quantum-classical hybrid framework based on the variational quantum eigensolver (VQE) has become the method of choice. In the literature, there are many different variants of VQE, but it is not known which one is optimal for a given molecule. For this purpose, we perform a thorough benchmarking on more than ten different kinds of VQE ansatzes (in systems up to 30 qubits), based on their performance on the energy accuracy, runtime until convergence, and number of parameters. Our results show that the ADAPT ansatz can be used to obtain more accurate energy for small systems (below 14 qubits), but it costs much more computational resources. For larger molecules, UCCSD0 has better performance. However, all the tested ansatzes can hardly reach chemical accuracy at stretched bond lengths. Our results were obtained using MindSpore Quantum, where the codes and the benchmarking toolkit are publicly available at Gitee.


title: Research on Data Fusion Algorithm Based on Deep Learning in Target Tracking

abstract: Aiming at the limitation that deep long and short-term memory network(DLSTM) algorithm cannot perform parallel computing and cannot obtain global information, in this paper, feature extraction and feature processing are firstly carried out according to the characteristics of eye movement data and tracking data, then by introducing a convolutional neural network (CNN) into a deep long and short-term memory network, developed a new network structure and designed a fusion strategy, an eye tracking data fusion algorithm based on long and short-term memory network is proposed. The experimental results show that compared with the two fusion algorithms based on deep learning, the algorithm proposed in this paper performs well in terms of fusion quality.


title: A Dual-scale Lead-seperated Transformer With Lead-orthogonal Attention And Meta-information For Ecg Classification

abstract: Auxiliary diagnosis of cardiac electrophysiological status can be obtained through the analysis of 12-lead electrocardiograms (ECGs). This work proposes a dual-scale lead-separated transformer with lead-orthogonal attention and meta-information (DLTM-ECG) as a novel approach to address this challenge. ECG segments of each lead are interpreted as independent patches, and together with the reduced dimension signal, they form a dual-scale representation. As a method to reduce interference from segments with low correlation, two group attention mechanisms perform both lead-internal and cross-lead attention. Our method allows for the addition of previously discarded meta-information, further improving the utilization of clinical information. Experimental results show that our DLTM-ECG yields significantly better classification scores than other transformer-based models,matching or performing better than state-of-the-art (SOTA) deep learning methods on two benchmark datasets. Our work has the potential for similar multichannel bioelectrical signal processing and physiological multimodal tasks.


title: Monitoring and Improving Personalized Sleep Quality from Long-Term Lifelogs

abstract: Sleep plays a vital role in our physical, cognitive, and psychological well-being. Despite its importance, long-term monitoring of personalized sleep quality (SQ) in real-world contexts is still challenging. Many sleep researches are still developing clinically and far from accessible to the general public. Fortunately, wearables and IoT devices provide the potential to explore the sleep insights from multimodal data, and have been used in some SQ researches. However, most of these studies analyze the sleep related data and present the results in a delayed manner (i.e., today's SQ obtained from last night's data), it is sill difficult for individuals to know how their sleep will be before they go to bed and how they can proactively improve it. To this end, this paper proposes a computational framework to monitor the individual SQ based on both the objective and subjective data from multiple sources, and moves a step further towards providing the personalized feedback to improve the SQ in a data-driven manner. The feedback is implemented by referring the insights from the PMData dataset based on the discovered patterns between life events and different levels of SQ. The deep learning based personal SQ model (PerSQ), using the long-term heterogeneous data and considering the carry-over effect, achieves higher prediction performance compared with baseline models. A case study also shows reasonable results for an individual to monitor and improve the SQ in the future.


title: Revealing inherent quantum interference and entanglement of a Dirac particle

abstract: Although originally predicted in relativistic quantum mechanics, Zitterbewegung can also appear in some classical systems, which leads to the important question of whether Zitterbewegung of Dirac particles is underlain by a more fundamental and universal interference behavior without classical analogs. We here reveal such an interference pattern in phase space, which underlies but goes beyond Zitterbewegung, and whose nonclassicality is manifested by the negativity of the phase space quasiprobability distribution, and the associated pseudospin-momentum entanglement. We confirm this discovery by numerical simulation and an on-chip experiment, where a superconducting qubit and a quantized microwave field respectively emulate the internal and external degrees of freedom of a Dirac particle. The measured quasiprobability negativities agree well with the numerical simulation. Besides being of fundamental importance, the demonstrated nonclassical effects are useful in quantum technology.


title: Fermi-normal coordinates for the Newtonian approximation of gravity

abstract: In this work, we compute the metric corresponding to a static and spherically symmetric mass distribution in the general relativistic weak field approximation to quadratic order in Fermi-normal coordinates surrounding a radial geodesic. To construct a geodesic and a convenient tetrad transported along it, we first introduce a general metric, use the Cartan formalism of differential forms, and then specialize the space-time by considering the nearly Newtonian metric. This procedure simplifies the calculations significantly, and the expression for the radial geodesic admits a simple form. We conclude that in quadratic order, the effects of a Schwarzschild gravitational field measured locally by a freely falling observer equals the measured by an observer in similar conditions in the presence of a Newtonian approximation of gravitation.


title: Breaking the Representation Bottleneck of Chinese Characters: Neural Machine Translation with Stroke Sequence Modeling

abstract: Existing research generally treats Chinese character as a minimum unit for representation. However, such Chinese character representation will suffer two bottlenecks: 1) Learning bottleneck, the learning cannot benefit from its rich internal features (e.g., radicals and strokes); and 2) Parameter bottleneck, each individual character has to be represented by a unique vector. In this paper, we introduce a novel representation method for Chinese characters to break the bottlenecks, namely StrokeNet, which represents a Chinese character by a Latinized stroke sequence (e.g., "ao1 (concave)" to "ajaie" and "tu1 (convex)" to "aeaqe"). Specifically, StrokeNet maps each stroke to a specific Latin character, thus allowing similar Chinese characters to have similar Latin representations. With the introduction of StrokeNet to neural machine translation (NMT), many powerful but not applicable techniques to non-Latin languages (e.g., shared subword vocabulary learning and ciphertext-based data augmentation) can now be perfectly implemented. Experiments on the widely-used NIST Chinese-English, WMT17 Chinese-English and IWSLT17 Japanese-English NMT tasks show that StrokeNet can provide a significant performance boost over the strong baselines with fewer model parameters, achieving 26.5 BLEU on the WMT17 Chinese-English task which is better than any previously reported results without using monolingual data. Code and scripts are freely available at https://github.com/zjwang21/StrokeNet.


title: Hand Avatar: Free-Pose Hand Animation and Rendering from Monocular Video

abstract: We present HandAvatar, a novel representation for hand animation and rendering, which can generate smoothly compositional geometry and self-occlusion-aware texture. Specifically, we first develop a MANO-HD model as a high-resolution mesh topology to fit personalized hand shapes. Sequentially, we decompose hand geometry into per-bone rigid parts, and then re-compose paired geometry encodings to derive an across-part consistent occupancy field. As for texture modeling, we propose a self-occlusion-aware shading field (SelF). In SelF, drivable anchors are paved on the MANO-HD surface to record albedo information under a wide variety of hand poses. Moreover, directed soft occupancy is designed to describe the ray-to-surface relation, which is leveraged to generate an illumination field for the disentanglement of pose-independent albedo and pose-dependent illumination. Trained from monocular video data, our HandAvatar can perform free-pose hand animation and rendering while at the same time achieving superior appearance fidelity. We also demonstrate that HandAvatar provides a route for hand appearance editing. Project website: https://seanchenxy.github.io/HandAvatarWeb.


title: Semantic-Aware Sensing Information Transmission for Metaverse: A Contest Theoretic Approach

abstract: With the advancement of network and computer technologies, virtual cyberspace keeps evolving, and Metaverse is the main representative. As an irreplaceable technology that supports Metaverse, the sensing information transmission from the physical world to Metaverse is vital. Inspired by emerging semantic communication, in this paper, we propose a semantic transmission framework for transmitting sensing information from the physical world to Metaverse. Leveraging the in-depth understanding of sensing information, we define the semantic bases, through which the semantic encoding of sensing data is achieved for the first time. Consequently, the amount of sensing data that needs to be transmitted is dramatically reduced. Unlike conventional methods that undergo data degradation and require data recovery, our approach achieves the sensing goal without data recovery while maintaining performance. To further improve Metaverse service quality, we introduce contest theory to create an incentive mechanism that motivates users to upload data more frequently. Experimental results show that the average data amount after semantic encoding is reduced to about 27.87% of that before encoding, while ensuring the sensing performance. Additionally, the proposed contest theoretic based incentive mechanism increases the sum of data uploading frequency by 27.47% compared to the uniform award scheme.


title: Learning Self-Awareness Models for Physical Layer Security in Cognitive and AI-enabled Radios

abstract: Cognitive Radio (CR) is a paradigm shift in wireless communications to resolve the spectrum scarcity issue with the ability to self-organize, self-plan and self-regulate. On the other hand, wireless devices that can learn from their environment can also be taught things by malicious elements of their environment, and hence, malicious attacks are a great concern in the CR, especially for physical layer security. This thesis introduces a data-driven Self-Awareness (SA) module in CR that can support the system to establish secure networks against various attacks from malicious users. Such users can manipulate the radio spectrum to make the CR learn wrong behaviours and take mistaken actions. The SA module consists of several functionalities that allow the radio to learn a hierarchical representation of the environment and grow its long-term memory incrementally. Therefore, this novel SA module is a way forward towards realizing the original vision of CR (i.e. Mitola's Radio) and AI-enabled radios. Experimental results show that introducing the novel SA functionalities provides the high accuracy of characterizing, detecting, classifying and predicting the jammer's activities and outperforms conventional detection methods such as Energy detectors and advanced classification methods such as Long Short-Term Memory (LSTM), Convolutional Neural Network (CNN) and Stacked Autoencoder (SAE). It also verifies that the proposed approach achieves a higher degree of explainability than deep learning techniques and verifies the capability to learn an efficient strategy to avoid future attacks with higher convergence speed compared to conventional Frequency Hopping and Q-learning.


title: Smoothing splines for discontinuous signals

abstract: Smoothing splines are twice differentiable by construction, so they cannot capture potential discontinuities in the underlying signal. In this work, we consider a special case of the weak rod model of Blake and Zisserman (1987) that allows for discontinuities penalizing their number by a linear term. The corresponding estimates are cubic smoothing splines with discontinuities (CSSD) which serve as representations of piecewise smooth signals and facilitate exploratory data analysis. However, computing the estimates requires solving a non-convex optimization problem. So far, efficient and exact solvers exist only for a discrete approximation based on equidistantly sampled data. In this work, we propose an efficient solver for the continuous minimization problem with non-equidistantly sampled data. Its worst case complexity is quadratic in the number of data points, and if the number of detected discontinuities scales linearly with the signal length, we observe linear growth in runtime. This efficient algorithm allows to use cross validation for automatic selection of the hyperparameters within a reasonable time frame on standard hardware. We provide a reference implementation and supplementary material. We demonstrate the applicability of the approach for the aforementioned tasks using both simulated and real data.


title: Nonlinear Equivariant Imaging: Learning Multi-Parametric Tissue Mapping without Ground Truth for Compressive Quantitative MRI

abstract: Current state-of-the-art reconstruction for quantitative tissue maps from fast, compressive, Magnetic Resonance Fingerprinting (MRF), use supervised deep learning, with the drawback of requiring high-fidelity ground truth tissue map training data which is limited. This paper proposes NonLinear Equivariant Imaging (NLEI), a self-supervised learning approach to eliminate the need for ground truth for deep MRF image reconstruction. NLEI extends the recent Equivariant Imaging framework to nonlinear inverse problems such as MRF. Only fast, compressed-sampled MRF scans are used for training. NLEI learns tissue mapping using spatiotemporal priors: spatial priors are obtained from the invariance of MRF data to a group of geometric image transformations, while temporal priors are obtained from a nonlinear Bloch response model approximated by a pre-trained neural network. Tested retrospectively on two acquisition settings, we observe that NLEI (self-supervised learning) closely approaches the performance of supervised learning, despite not using ground truth during training.


title: Program Repair

abstract: Automated program repair is an emerging technology which consists of a suite of techniques to automatically fix bugs or vulnerabilities in programs. In this paper, we present a comprehensive survey of the state of the art in program repair. We first study the different suite of techniques used including search based repair, constraint based repair and learning based repair. We then discuss one of the main challenges in program repair namely patch overfitting, by distilling a class of techniques which can alleviate patch overfitting. We then discuss classes of program repair tools, applications of program repair as well as uses of program repair in industry. We conclude the survey with a forward looking outlook on future usages of program repair, as well as research opportunities arising from work on code from large language models.


title: Entanglement-enhanced Synchronous differential comparison

abstract: The quantum entanglement enables the precision measurement and frequency metrology beyond the standard quantum limit that is imposed by the quantum projection noise and photon shot noise. Here we propose employing the entangled atoms in the synchronous differential measurement to enhance the sensitivity of the spatial-shift detection. Two ways of engineering the entangled atoms are studied. The synchronous comparison between two pixels within an entangled atomic cloud leads to a sensitivity enhancement factor of 1.4 over the standard quantum limit. Increasing the atom number hardly further improves the sensitivity. In contrast, the synchronous comparison between two independent pixels that are individually composed of entangled atoms allows for a strong sensitivity enhancement by a factor of, for example, 9.7 with $10^{3}$ entangled atoms in each pixel, corresponding to a reduction of the averaging time by a factor of about $10^{2}$. A large atom number may further elevate the sensitivity. Our work paves the way towards the entanglement-enhanced detection of the gravitational redshift by means of the \emph{in situ} imaging spectroscopy.


title: Hidden Factor estimation in Dynamic Generalized Factor Analysis Models

abstract: This paper deals with the estimation of the hidden factor in Dynamic Generalized Factor Analysis via a generalization of Kalman filtering. Asymptotic consistency is discussed and it is shown that the Kalman one-step predictor is not the right tool while the pure filter yields a consistent estimate.


title: Haploid algebras in $C^*$-tensor categories and the Schellekens list

abstract: We prove that a haploid associative algebra in a $C^*$-tensor category $\mathcal{C}$ is equivalent to a Q-system (a special $C^*$-Frobenius algebra) in $\mathcal{C}$ if and only if it is rigid. This allows us to prove the unitarity of all the 70 strongly rational holomorphic vertex operator algebras with central charge $c=24$ and non-zero weight-one subspace, corresponding to entries 1-70 of the so called Schellekens list. Furthermore, using the recent generalized deep hole construction of these vertex operator algebras, we prove that they are also strongly local in the sense of Carpi, Kawahigashi, Longo and Weiner and consequently we obtain some new holomorphic conformal nets associated to the entries of the list. Finally, we completely classify the simple CFT type vertex operator superalgebra extensions of the unitary $N=1$ and $N=2$ super-Virasoro vertex operator superalgebras with central charge $c<\frac{3}{2}$ and $c<3$ respectively, relying on the known classification results for the corresponding superconformal nets.


title: An ensemble of VisNet, Transformer-M, and pretraining models for molecular property prediction in OGB Large-Scale Challenge @ NeurIPS 2022

abstract: In the technical report, we provide our solution for OGB-LSC 2022 Graph Regression Task. The target of this task is to predict the quantum chemical property, HOMO-LUMO gap for a given molecule on PCQM4Mv2 dataset. In the competition, we designed two kinds of models: Transformer-M-ViSNet which is an geometry-enhanced graph neural network for fully connected molecular graphs and Pretrained-3D-ViSNet which is a pretrained ViSNet by distilling geomeotric information from optimized structures. With an ensemble of 22 models, ViSNet Team achieved the MAE of 0.0723 eV on the test-challenge set, dramatically reducing the error by 39.75% compared with the best method in the last year competition.


title: MECCH: Metapath Context Convolution-based Heterogeneous Graph Neural Networks

abstract: Heterogeneous graph neural networks (HGNNs) were proposed for representation learning on structural data with multiple types of nodes and edges. To deal with the performance degradation issue when HGNNs become deep, researchers combine metapaths into HGNNs to associate nodes closely related in semantics but far apart in the graph. However, existing metapath-based models suffer from either information loss or high computation costs. To address these problems, we present a novel Metapath Context Convolution-based Heterogeneous Graph Neural Network (MECCH). MECCH leverages metapath contexts, a new kind of graph structure that facilitates lossless node information aggregation while avoiding any redundancy. Specifically, MECCH applies three novel components after feature preprocessing to extract comprehensive information from the input graph efficiently: (1) metapath context construction, (2) metapath context encoder, and (3) convolutional metapath fusion. Experiments on five real-world heterogeneous graph datasets for node classification and link prediction show that MECCH achieves superior prediction accuracy compared with state-of-the-art baselines with improved computational efficiency.


title: Low Rank Quaternion Matrix Completion Based on Quaternion QR Decomposition and Sparse Regularizer

abstract: Matrix completion is one of the most challenging problems in computer vision. Recently, quaternion representations of color images have achieved competitive performance in many fields. Because it treats the color image as a whole, the coupling information between the three channels of the color image is better utilized. Due to this, low-rank quaternion matrix completion (LRQMC) algorithms have gained considerable attention from researchers. In contrast to the traditional quaternion matrix completion algorithms based on quaternion singular value decomposition (QSVD), we propose a novel method based on quaternion Qatar Riyal decomposition (QQR). In the first part of the paper, a novel method for calculating an approximate QSVD based on iterative QQR is proposed (CQSVD-QQR), whose computational complexity is lower than that of QSVD. The largest $r \ (r>0)$ singular values of a given quaternion matrix can be computed by using CQSVD-QQR. Then, we propose a new quaternion matrix completion method based on CQSVD-QQR which combines low-rank and sparse priors of color images. Experimental results on color images and color medical images demonstrate that our model outperforms those state-of-the-art methods.


title: Zero Forcing Uplink Detection through Large-Scale RIS: System Performance and Phase Shift Design

abstract: A multiple-input multiple-output wireless communication system is analytically studied, which operates with the aid of a large-scale reconfigurable intelligent surface (LRIS). LRIS is equipped with multiple passive elements with discrete phase adjustment capabilities, and independent Rician fading conditions are assumed for both the transmitter-to-LRIS and LRIS-to-receiver links. A direct transceiver link is also considered which is modeled by Rayleigh fading distribution. The system performance is analytically studied when the linear yet efficient zero-forcing detection is implemented at the receiver. In particular, the outage performance is derived in closed-form expression for different system configuration setups with regards to the available channel state information (CSI) at the receiver. In fact, the case of both perfect and imperfect CSI is analyzed. Also, an efficient phase shift design approach at LRIS is introduced, which is linear on the number of passive elements and receive antennas. The proposed phase shift design can be applied on two different modes of operation; namely, when the system strives to adapt either on the instantaneous or statistical CSI. Finally, some impactful engineering insights are provided, such as how the channel fading conditions, CSI, discrete phase shift resolution, and volume of antenna/LRIS element arrays impact on the overall system performance.


title: Kernels of operators on certain Banach spaces associated with almost disjoint families

abstract: Given an infinite set $\Gamma$ and an almost disjoint family $\mathcal{A}$ on $\Gamma$, let $Y_{\mathcal{A}}$ denote the closed subspace of $\ell_\infty(\Gamma)$ spanned by the indicator functions $1_{\bigcap_{j=1}^n A_j}$ for $n\in\mathbb{N}$ and $A_1,\ldots,A_n\in\mathcal{A}$. We show that if $\mathcal{A}$ has cardinality greater than $\Gamma$, then $Y_{\mathcal{A}}$ contains closed subspaces which cannot be realised as the kernels of any bounded operators $Y_{\mathcal{A}}\rightarrow \ell_{\infty}(\Gamma)$. Consequently the spaces $\ell_{\infty}(\Gamma)$, for any infinite set $\Gamma$, and $C_0(K_{\mathcal{A}})$, where $\mathcal{A}$ is an uncountable almost disjoint family on $\mathbb{N}$ and $K_{\mathcal{A}}$ the locally compact Mr\'{o}wka space associated with $\mathcal{A}$, contain closed subspaces which do not arise as the kernels of any bounded operators on them.


title: IMaSC -- ICFOSS Malayalam Speech Corpus

abstract: Modern text-to-speech (TTS) systems use deep learning to synthesize speech increasingly approaching human quality, but they require a database of high quality audio-text sentence pairs for training. Malayalam, the official language of the Indian state of Kerala and spoken by 35+ million people, is a low resource language in terms of available corpora for TTS systems. In this paper, we present IMaSC, a Malayalam text and speech corpora containing approximately 50 hours of recorded speech. With 8 speakers and a total of 34,473 text-audio pairs, IMaSC is larger than every other publicly available alternative. We evaluated the database by using it to train TTS models for each speaker based on a modern deep learning architecture. Via subjective evaluation, we show that our models perform significantly better in terms of naturalness compared to previous studies and publicly available models, with an average mean opinion score of 4.50, indicating that the synthesized speech is close to human quality.


title: The circular polarization of the Mn I resonance lines around 280 nm for exploring chromospheric magnetism

abstract: We study the circular polarization of the Mn I resonance lines at 279.56, 279.91, and 280.19 nm (hereafter, UV multiplet) by means of radiative transfer modeling. In 2019, the CLASP2 mission obtained unprecedented spectropolarimetric data in a region of the solar ultraviolet including the Mg II h and k resonance lines and two lines of a subordinate triplet, as well as two Mn I resonance lines. The first analysis of such data, in particular those corresponding to a plage region, allowed the inference of the longitudinal magnetic field from the photosphere to the upper chromosphere just below the transition region. This was achieved by applying the weak field approximation to the circular polarization profiles of the Mg II and Mn I lines. While the applicability of this approximation to the Mg II lines was already demonstrated in previous works, this is not the case for the Mn I UV multiplet. These lines are observed as absorptions between the Mg II h and k lines, a region whose intensity is shaped by their partial frequency redistribution effects. Moreover, the only Mn I stable isotope has nuclear spin $I=5/2$ and thus hyperfine structure must be, a priori, taken into account. Here we study the generation and transfer of the intensity and circular polarization of the Mn I resonance lines accounting for these physical ingredients. We analyze their sensitivity to the magnetic field by means of their response function, and we demonstrate the applicability of the weak field approximation to determine the longitudinal component of the magnetic field.


title: An Open Case-based Reasoning Framework for Personalized On-board Driving Assistance in Risk Scenarios

abstract: Driver reaction is of vital importance in risk scenarios. Drivers can take correct evasive maneuver at proper cushion time to avoid the potential traffic crashes, but this reaction process is highly experience-dependent and requires various levels of driving skills. To improve driving safety and avoid the traffic accidents, it is necessary to provide all road drivers with on-board driving assistance. This study explores the plausibility of case-based reasoning (CBR) as the inference paradigm underlying the choice of personalized crash evasive maneuvers and the cushion time, by leveraging the wealthy of human driving experience from the steady stream of traffic cases, which have been rarely explored in previous studies. To this end, in this paper, we propose an open evolving framework for generating personalized on-board driving assistance. In particular, we present the FFMTE model with high performance to model the traffic events and build the case database; A tailored CBR-based method is then proposed to retrieve, reuse and revise the existing cases to generate the assistance. We take the 100-Car Naturalistic Driving Study dataset as an example to build and test our framework; the experiments show reasonable results, providing the drivers with valuable evasive information to avoid the potential crashes in different scenarios.


title: Benchmarking JSON BinPack

abstract: In this paper, we present benchmark results for a pre-production implementation of a novel serialization specification: JSON BinPack. JSON BinPack is a schema-driven and schema-less sequential binary serialization specification based on JSON Schema. It is rich in diverse encodings, and is developed to improve network performance and reduce the operational costs of Internet-based software systems. We present benchmark results for 27 JSON documents and for each plot, we show the schema-driven and schema-less serialization specifications that produce the smallest bit-strings. Through extensive plots and statistical comparisons, we show that JSON BinPack in schema-driven mode is as space-efficient or more space-efficient than every other serialization specification for the 27 documents under consideration. In comparison to JSON, JSON BinPack in schema-driven mode provides a median and average size reductions of 86.7% and 78.7%, respectively. We also show that the schema-less mode of the JSON BinPack binary serialization specification is as space-efficient or more space-efficient than every other schema-less serialization specification for the 27 documents under consideration. In comparison to JSON, JSON BinPack in schema-less mode provides a median and average size reductions of 30.6% and 30.5%, respectively. Unlike other considered schema-driven binary serialization specifications, JSON BinPack in schema-driven mode is space-efficient in comparison to best-case compressed JSON in terms of the median and average with size reductions of 76.1% and 66.8%, respectively. We have made our benchmark results available at jviotti/binary-json-size-benchmark on GitHub.


title: An intertwining between conformal dualities and ordinary dualities

abstract: We discuss and reinterpret a 4d conformal triality recently discovered in the literature in terms of ordinary Seiberg duality. We observe that a non-abelian global symmetry is explicitly realized by only two out of the three phase. We corroborate the result by matching the superconformal index in terms of an expansion on the fugacities.


title: The distribution of the number of automorphisms of random trees

abstract: We study the size of the automorphism group of two different types of random trees: Galton--Watson trees and rooted P\'olya trees. In both cases, we prove that it asymptotically follows a log-normal distribution and provide asymptotic formulas for mean and variance of the logarithm of the size of the automorphism group. While the proof for Galton--Watson trees mainly relies on probabilistic arguments and a general result on additive tree functionals, generating functions are used in the case of rooted P\'olya trees. We also show how to extend the results to some classes of unrooted trees.


title: Finely quasiconformal mappings

abstract: We introduce a relaxed version of the metric definition of quasiconformality that is natural also for mappings of low regularity, including $W_{\mathrm{loc}}^{1,1}(\mathbb{R}^n;\mathbb{R}^n)$-mappings. Then we show on the plane that this relaxed definition can be used to prove Sobolev regularity, and that these ``finely quasiconformal'' mappings are in fact quasiconformal.


title: You Don't Know When I Will Arrive: Unpredictable Controller Synthesis for Temporal Logic Tasks

abstract: In this paper, we investigate the problem of synthesizing controllers for temporal logic specifications under security constraint. We assume that there exists a passive intruder (eavesdropper) that can partially observe the behavior of the system. For the purpose of security, we require that the system's behaviors are unpredictable in the sense that the intruder cannot determine for sure that the system will exactly accomplish the task in $K$ steps ahead. This problem is particularly challenging since future information is involved in the synthesis process. We propose a novel information structure that predicts the effect of control in the future. A sound and complete algorithm is developed to synthesize a controller which ensures both task completion and security guarantee. The proposed approach is illustrated by a case study of robot task planning.


title: New additivity properties of the relative entropy of entanglement and its generalizations

abstract: We prove that the relative entropy of entanglement is additive when \emph{at least one of the two states} belongs to some specific class. We show that these classes include bipartite pure, maximally correlated, GHZ, Bell diagonal, isotropic, and generalized Dicke states. Previously, additivity was established only if \textit{both} states belong to the same class. Moreover, we extend these results to entanglement monotones based on the $\alpha$-$z$ R\'enyi relative entropy. Notably, this family of monotones includes also the generalized robustness of entanglement and the geometric measure of entanglement. In addition, we prove that any monotone based on a quantum relative entropy is not additive for general states. We also compute closed-form expressions of the monotones for bipartite pure, Bell diagonal, isotropic, generalized Werner, generalized Dicke, and maximally correlated Bell diagonal states. Our results rely on developing a method that allows us to recast the initial convex optimization problem into a simpler linear one. Even though we mostly focus on entanglement theory, we expect that some of our technical results could be useful in investigating more general convex optimization problems.


title: Markov decision processes with maximum entropy rate for Surveillance Tasks

abstract: We consider the problem of synthesizing optimal policies for Markov decision processes (MDP) for both utility objective and security constraint. Specifically, our goal is to maximize the \emph{entropy rate} of the MDP while achieving a surveillance task in the sense that a given region of interest is visited infinitely often with probability one. Such a policy is of our interest since it guarantees both the completion of tasks and maximizes the \emph{unpredictability} of limit behavior of the system. Existing works either focus on the total entropy or do not consider the surveillance tasks which are not suitable for surveillance tasks with infinite horizon. We provide a complete solution to this problem. Specifically, we present an algorithm for synthesizing entropy rate maximizing policies for communicating MDPs. Then based on a new state classification method, we show the entropy rate maximization problem under surveillance task can be effectively solved in polynomial-time. We illustrate the proposed algorithm based on a case study of robot planning scenario.


title: Learning trivializing flows

abstract: The recent introduction of machine learning techniques, especially normalizing flows, for the sampling of lattice gauge theories has shed some hope on improving the sampling efficiency of the traditional HMC algorithm. Naive use of normalizing flows has been shown to lead to bad scaling with the volume. In this talk we propose using local normalizing flows at a scale given by the correlation length. Even if naively these transformations have a small acceptance, when combined with the HMC algorithm lead to algorithms with high acceptance, and also with reduced autocorrelation times compared with HMC. Several scaling tests are performed in the $\phi^{4}$ theory in 2D.


title: Sub-mm/mm optical properties of real protoplanetary matter derived from Rosetta/MIRO observations of comet 67P

abstract: Optical properties are required for the correct understanding and modelling of protoplanetary and debris discs. By assuming that comets are the most pristine bodies in the solar system, our goal is to derive optical constants of real protoplanetary material. We determine the complex index of refraction of the near-surface material of comet 67P/Churyumov-Gerasimenko by fitting the sub-millimetre/millimetre observations of the thermal emission of the comet's sub-surface made by the Microwave Instrument for the Rosetta Orbiter (MIRO) with synthetic temperatures derived from a thermophysical model and radiative-transfer models. According to the two major formation scenarios of comets, we model the sub-surface layers to consist of pebbles as well as of homogeneously packed dust grains. In the case of a homogeneous dusty surface material, we find a solution for the length-absorption coefficient of $\alpha \approx 0.22~\mathrm{cm^{-1}}$ for a wavelength of 1.594 mm and $\alpha \geq 3.84~\mathrm{cm^{-1}}$ for a wavelength of 0.533 mm and a constant thermal conductivity of $0.006~\mathrm{Wm^{-1}K^{-1}}$. For the pebble scenario, we find for the pebbles and a wavelength of 1.594 mm a complex refractive index of $n = (1.074 - 1.256) + \mathrm{i} \, (2.580 - 7.431)\cdot 10^{-3}$ for pebble radii between 1 mm and 6 mm. Taking into account other constraints, our results point towards a pebble makeup of the cometary sub-surface with pebble radii between 3 mm and 6 mm. The derived real part of the refractive index is used to constrain the composition of the pebbles and their volume filling factor. The optical and physical properties are discussed in the context of protoplanetary and debris disc observations.


title: Radial Oscillations of Dark Matter admixed Neutron Stars

abstract: Within the relativistic mean-field model, we investigate the properties of dark matter (DM) admixed neutron stars, considering non-rotating objects made of isotropic matter. We adopt the IOPB-I hadronic equation of state (EOS) by assuming that the fermionic DM within super-symmetric models has already been accreted inside the neutron star (NS). The impact of DM on the mass-radius relationships and the radial oscillations of pulsating DM admixed neutron stars (with and without the crust) are explored. It is observed that the presence of DM softens the EOS, which in turn lowers the maximum mass and its corresponding radius. Moreover, adding DM results in higher frequencies of pulsating objects and hence we show the linearity of fundamental mode frequency of canonical NS with DM Fermi momentum. We also investigate the profile of eigenfunctions solving the Sturm-Liouville boundary value problem, and verify its validity. Further, we study the stability of NSs considering the fundamental mode frequency variation with the mass of the star, and verify the stability criterion $\partial M/\partial\rho_c > 0$. Finally, the effect of the crust on the large frequency separation for different DM Fermi momenta is shown as well.


title: A comparative study of source-finding techniques in HI emission line cubes using SoFiA, MTObjects, and supervised deep learning

abstract: The 21 cm spectral line emission of atomic neutral hydrogen (HI) is one of the primary wavelengths observed in radio astronomy. However, the signal is intrinsically faint and the HI content of galaxies depends on the cosmic environment, requiring large survey volumes and survey depth to investigate the HI Universe. As the amount of data coming from these surveys continues to increase with technological improvements, so does the need for automatic techniques for identifying and characterising HI sources while considering the tradeoff between completeness and purity. This study aimed to find the optimal pipeline for finding and masking the most sources with the best mask quality and the fewest artefacts in 3D neutral hydrogen cubes. Various existing methods were explored in an attempt to create a pipeline to optimally identify and mask the sources in 3D neutral hydrogen 21 cm spectral line data cubes. Two traditional source-finding methods were tested, SoFiA and MTObjects, as well as a new supervised deep learning approach, in which a 3D convolutional neural network architecture, known as V-Net was used. These three source-finding methods were further improved by adding a classical machine learning classifier as a post-processing step to remove false positive detections. The pipelines were tested on HI data cubes from the Westerbork Synthesis Radio Telescope with additional inserted mock galaxies. SoFiA combined with a random forest classifier provided the best results, with the V-Net-random forest combination a close second. We suspect this is due to the fact that there are many more mock sources in the training set than real sources. There is, therefore, room to improve the quality of the V-Net network with better-labelled data such that it can potentially outperform SoFiA.

categories: astro-ph.IM astro-ph.GA cs.AI cs.CV cs.LG


title: Lattice eddy simulation of turbulent flows

abstract: Kolmogorov's (1941) theory of self-similarity implies the universality of small-scale eddies, and holds promise for a universal sub-grid scale model for large eddy simulation. The fact is the empirical coefficient of a typical sub-grid scale model varies from 0.1 to 0.2 in free turbulence and damps gradually to zero approaching the walls. This work has developed a Lattice Eddy Simulation method (LAES), in which the sole empirical coefficient is constant (Cs=0.08). LAES assumes the fluid properties are stored in the nodes of a typical CFD mesh, treats the nodes as lattices and makes analysis on one specific lattice, i. To be specific, LAES express the domain derivative on that lattice with the influence of nearby lattices. The lattices right next to i, which is named as i+, "collide" with i, imposing convective effects on i. The lattices right next to i+, which is named as i++, impose convective effects on i+ and indirectly influence i. The influence is actually turbulent diffusion. The derived governing equations of LAES look like the Navier-Stokes equations and reduce to filtered Naiver-Stokes equations with the Smagorinsky sub-grid scale model (Smagorinsky 1963) on meshes with isotropic cells. LAES yields accurate predictions of turbulent channel flows at Re=180, 395, and 590 on very coarse meshes and LAES with a constant Cs perform as well as the dynamic LES model (Germano et al. 1991) does. Thus, this work has provided strong evidence for Kolmogorov's theory of self-similarity.


title: Configurational forces on elastic structures

abstract: The discovery of configurational forces acting on elastic structures and its initial applications are reviewed. Configurational forces are related to the possibility that an elastic structure can change its configuration, thus inducing a variation in the potential energy. This concept has already led to several applications (the elastica arm scale, the dripping of an elastic rod, and the torsional actuator), has been shown to strongly affect stability, and to be related to limbless locomotion. It is believed that these results will open a new research territory in mechanics.


title: A Prym-Narasimhan-Ramanan construction of principal bundle fixed points

abstract: Let $X$ be a compact Riemann surface and $G$ be a connected reductive complex Lie group with centre $Z$. Consider the moduli space $M(X,G)$ of polystable principal holomorphic $G$-bundles on $X$. There is an action of the group $H^1(X,Z)$ of isomorphism classes of $Z$-bundles over $X$ on $M(X,G)$ induced by the multiplication $Z\times G\to G.$ Let $\Gamma$ be a finite subgroup of $H^1(X,Z)$. Our goal is to find a Prym--Narasimhan--Ramanan-type construction to describe the fixed points of $M(X,G)$ under the action of $\Gamma$. A main ingredient in this construction is the theory of twisted equivariant bundles on an \'etale cover of $X$ developed in arXiv:2208.0902(2).


title: On the expansion constant and distance constrained colourings of hypergraphs

abstract: For any two non-negative integers h and k, h > k, an L(h, k)-colouring of a graph G is a colouring of vertices such that adjacent vertices admit colours that at least differ by h and vertices that are two distances apart admit colours that at least differ by k. The smallest positive integer {\delta} such that G permits an L(h, k)-colouring with maximum colour {\delta} is known as the L(h, k)-chromatic number (L(h, k)-colouring number) denoted by {\lambda}_{h,k}(G). In this paper, we discuss some interesting invariants in hypergraphs. In fact, we study the relation between the spectral gap and L(2, 1)-chromatic number of hypergraphs. We derive some inequalities which relates L(2, 1)-chromatic number of a k-regular simple graph to its spectral gap and expansion constant. The upper bound of L(h, k)-chromatic number in terms of various hypergraph invariants such as strong chromatic number, strong independent number and maximum degree is obtained. We determine the sharp upper bound for L(2, 1)-chromatic number of hypertrees in terms of its maximum degree. Finally, we conclude this paper with a discussion on L(2, 1)-colouring in cartesian product of some classes of hypergraphs.


title: Vertical Federated Learning: Concepts, Advances and Challenges

abstract: Vertical Federated Learning (VFL) is a federated learning setting where multiple parties with different features about the same set of users jointly train machine learning models without exposing their raw data or model parameters. Motivated by the rapid growth in VFL research and real-world applications, we provide a comprehensive review of the concept and algorithms of VFL, as well as current advances and challenges in various aspects, including effectiveness, efficiency, and privacy. We provide an exhaustive categorization for VFL settings and privacy-preserving protocols and comprehensively analyze the privacy attacks and defense strategies for each protocol. In the end, we propose a unified framework, termed VFLow, which considers the VFL problem under communication, computation, privacy, as well as effectiveness and fairness constraints. Finally, we review the most recent advances in industrial applications, highlighting open challenges and future directions for VFL.


title: Jamming and metastability in one dimension: from the kinetically constrained Ising chain to the Riviera model

abstract: The Ising chain with kinetic constraints provides many examples of totally irreversible zero-temperature dynamics leading to metastability with an exponentially large number of attractors. In most cases, the constrained zero-temperature dynamics can be mapped onto a model of random sequential adsorption. We provide a brief didactic review, based on the example of the constrained Glauber-Ising chain, of the exact results on the dynamics of these models and on their attractors that have been obtained by means of the above mapping. The Riviera model introduced recently by Puljiz et al. behaves similarly to the kinetically constrained Ising chains. This totally irreversible deposition model however does not enjoy the shielding property characterising models of random sequential adsorption. It can therefore neither be mapped onto such a model nor (in all likelihood) be solved by analytical means. We present a range of novel results on the attractors of the Riviera model, obtained by means of an exhaustive enumeration for smaller systems and of extensive simulations for larger ones, and put these results in perspective with the exact ones which are available for kinetically constrained Ising chains.


title: Satellite knots that cannot be represented by positive braids with full twists

abstract: A positive braid with at least one full twist is known to be a minimal braid, i.e, it achieves the braid index for its closure. In this paper we find knots that are the closure of positive minimal braids that cannot be represented by positive braids with full twists. More precisely, we show that some satellite knots with companions and patterns given as the closure of positive braids cannot be represented as the closure of positive braids with full twists. As a consequence, we find infinitely many satellite knots with companions and patterns being Lorenz knots that are not Lorenz knots. This gives an answer to the question whether a satellite knot having Lorenz pattern and companion is also a Lorenz knot, originally addressed by Birman and Williams in a special case in the 1980s.


title: Reason from Context with Self-supervised Learning

abstract: Self-supervised learning (SSL) learns to capture discriminative visual features useful for knowledge transfers. To better accommodate the object-centric nature of current downstream tasks such as object recognition and detection, various methods have been proposed to suppress contextual biases or disentangle objects from contexts. Nevertheless, these methods may prove inadequate in situations where object identity needs to be reasoned from associated context, such as recognizing or inferring tiny or obscured objects. As an initial effort in the SSL literature, we investigate whether and how contextual associations can be enhanced for visual reasoning within SSL regimes, by (a) proposing a new Self-supervised method with external memories for Context Reasoning (SeCo), and (b) introducing two new downstream tasks, lift-the-flap and object priming, addressing the problems of "what" and "where" in context reasoning. In both tasks, SeCo outperformed all state-of-the-art (SOTA) SSL methods by a significant margin. Our network analysis revealed that the proposed external memory in SeCo learns to store prior contextual knowledge, facilitating target identity inference in the lift-the-flap task. Moreover, we conducted psychophysics experiments and introduced a Human benchmark in Object Priming dataset (HOP). Our results demonstrate that SeCo exhibits human-like behaviors.


title: Local uniqueness of the solutions for a singularly perturbed nonlinear nonautonomous transmission problem

abstract: We consider the Laplace equation in a domain of $\mathbb{R}^n$, $n\ge 3$, with a small inclusion of size $\epsilon$. On the boundary of the inclusion we define a nonlinear nonautonomous transmission condition. For $\epsilon$ small enough one can prove that the problem has solutions. In this paper, we study the local uniqueness of such solutions.


title: Tracking biomedical articles along the translational continuum: a measure based on biomedical knowledge representation

abstract: Keeping track of translational research is essential to evaluating the performance of programs on translational medicine. Despite several indicators in previous studies, a consensus measure is still needed to represent the translational features of biomedical research at the article level. In this study, we first trained semantic representations of biomedical entities and documents (i.e., bio entity2vec and bio doc2vec) based on over 30 million PubMed articles. With these vectors, we then developed a new measure called Translational Progression (TP) for tracking biomedical articles along the translational continuum. We validated the effectiveness of TP from two perspectives (Clinical trial phase identification and ACH classification), which showed excellent consistency between TP and other indicators. Meanwhile, TP has several advantages. First, it can track the degree of translation of biomedical research dynamically and in real time. Second, it is straightforward to interpret and operationalize. Third, it doesn%u2019t require labor-intensive MeSH labeling and it is suitable for big scholarly data as well as papers that are not indexed in PubMed. In addition, we examined the translational progressions of biomedical research from three dimensions (including overall distribution, time, and research topic), which revealed three significant findings. The proposed measure in this study could be used by policymakers to monitor biomedical research with high translational potential in real time and make better decisions. It can also be adopted and improved for other domains, such as physics or computer science, to assess the application value of scientific discoveries.


title: Fairly Allocating Utility in Constrained Multiwinner Elections

abstract: Fairness in multiwinner elections is studied in varying contexts. For instance, diversity of candidates and representation of voters are both separately termed as being fair. A common denominator to ensure fairness across all such contexts is the use of constraints. However, across these contexts, the candidates selected to satisfy the given constraints may systematically lead to unfair outcomes for historically disadvantaged voter populations as the cost of fairness may be borne unequally. Hence, we develop a model to select candidates that satisfy the constraints fairly across voter populations. To do so, the model maps the constrained multiwinner election problem to a problem of fairly allocating indivisible goods. We propose three variants of the model, namely, global, localized, and inter-sectional. Next, we analyze the model's computational complexity, and we present an empirical analysis of the utility traded-off across various settings of our model across the three variants and discuss the impact of Simpson's paradox using synthetic datasets and a dataset of voting at the United Nations. Finally, we discuss the implications of our work for AI and machine learning, especially for studies that use constraints to guarantee fairness.


title: Explainable AI for Pre-Trained Code Models: What Do They Learn? When They Do Not Work?

abstract: In recent years, there has been a wide interest in designing deep neural network-based models that automate downstream software engineering tasks on source code, such as code document generation, code search, and program repair. Although the main objective of these studies is to improve the effectiveness of the downstream task, many studies only attempt to employ the next best neural network model, without a proper in-depth analysis of why a particular solution works or does not, on particular tasks or scenarios. In this paper, using an example eXplainable AI (XAI) method (attention mechanism), we study two recent large language models (LLMs) for code (CodeBERT and GraphCodeBERT) on a set of software engineering downstream tasks: code document generation (CDG), code refinement (CR), and code translation (CT). Through quantitative and qualitative studies, we identify what CodeBERT and GraphCodeBERT learn (put the highest attention on, in terms of source code token types), on these tasks. We also show some of the common patterns when the model does not work as expected (performs poorly even on easy problems) and suggest recommendations that may alleviate the observed challenges.


title: Non-symmetric intrinsic Hopf-Lax semigroup vs. intrinsic Lagrangian

abstract: In this paper, we analyze the 'symmetrized' of the intrinsic Hopf-Lax semigroup introduced by the author in the context of the intrinsically Lipschitz sections in the setting of metric spaces. Indeed, in the usual case, we have that $d(x,y) =d(y,x)$ for any point $x$ and $y$ belong to the metric space $X$; on the other hand, in our intrinsic context, we have that $d(f(x),\pi^{-1} (y)) \ne d(f(y),\pi^{-1} (x)),$ for every $x,y \in X$. Therefore, it is not trivial that we get the same result obtained for the "classical" intrinsic Hopf-Lax semigroup, i.e., the 'symmetrized' Hopf-Lax semigroup is a subsolution of Hamilton-Jacobi type equation. Here, an important observation is that $f$ is just a continuous section of a quotient map $\pi$ and it can not intrinsic Lipschitz. However, following Evans, the main result of this note is to show that the "new" intrinsic Hopf-Lax semigroup satisfies a suitable variational problem where the functional contained an intrinsic Lagrangian. Hence, we also define and prove some basic properties of the intrinsic Fenchel-Legendre transform of this intrinsic Lagrangian that depends on a continuous section of $\pi$.


title: Quasinormal mode representation of radiating resonators in open phononic systems

abstract: Open phononic systems including resonators radiating inside an unbounded medium support localized phonons characterized by a complex frequency. In this context, the concept of elastic quasinormal mode (QNM) arises naturally, as in the cases of nanophotonic and plasmonic open systems. Based on a complex, unconjugated form of reciprocity theorem for elastodynamics, the eigenfunction expansion theorem expressed on the elastic QNM basis yields an accurate approximation to the response function, for an arbitrary excitation. The description of the elastic Purcell effect then requires defining a complex-valued modal volume for each QNM. For validation, we first consider the case a vibrating nylon rod radiating in water. As a second test example, we consider a slender nickel ridge on the surface of a fused silica substrate, before extending our attention to a nanoscale tuning fork composed of two such ridges. In all cases, the response estimated from only a few elastic QNMs agrees with the solution to the elastodynamic equation.


title: Tell Me What Happened: Unifying Text-guided Video Completion via Multimodal Masked Video Generation

abstract: Generating a video given the first several static frames is challenging as it anticipates reasonable future frames with temporal coherence. Besides video prediction, the ability to rewind from the last frame or infilling between the head and tail is also crucial, but they have rarely been explored for video completion. Since there could be different outcomes from the hints of just a few frames, a system that can follow natural language to perform video completion may significantly improve controllability. Inspired by this, we introduce a novel task, text-guided video completion (TVC), which requests the model to generate a video from partial frames guided by an instruction. We then propose Multimodal Masked Video Generation (MMVG) to address this TVC task. During training, MMVG discretizes the video frames into visual tokens and masks most of them to perform video completion from any time point. At inference time, a single MMVG model can address all 3 cases of TVC, including video prediction, rewind, and infilling, by applying corresponding masking conditions. We evaluate MMVG in various video scenarios, including egocentric, animation, and gaming. Extensive experimental results indicate that MMVG is effective in generating high-quality visual appearances with text guidance for TVC.