title: Recursion in Recursion: Two-Level Nested Recursion for Length Generalization with Scalability

abstract: Binary Balanced Tree RvNNs (BBT-RvNNs) enforce sequence composition according to a preset balanced binary tree structure. Thus, their non-linear recursion depth is just $\log_2 n$ ($n$ being the sequence length). Such logarithmic scaling makes BBT-RvNNs efficient and scalable on long sequence tasks such as Long Range Arena (LRA). However, such computational efficiency comes at a cost because BBT-RvNNs cannot solve simple arithmetic tasks like ListOps. On the flip side, RvNNs (e.g., Beam Tree RvNN) that do succeed on ListOps (and other structure-sensitive tasks like formal logical inference) are generally several times more expensive than even RNNs. In this paper, we introduce a novel framework -- Recursion in Recursion (RIR) to strike a balance between the two sides - getting some of the benefits from both worlds. In RIR, we use a form of two-level nested recursion - where the outer recursion is a $k$-ary balanced tree model with another recursive model (inner recursion) implementing its cell function. For the inner recursion, we choose Beam Tree RvNNs (BT-RvNN). To adjust BT-RvNNs within RIR we also propose a novel strategy of beam alignment. Overall, this entails that the total recursive depth in RIR is upper-bounded by $k \log_k n$. Our best RIR-based model is the first model that demonstrates high ($\geq 90\%$) length-generalization performance on ListOps while at the same time being scalable enough to be trainable on long sequence inputs from LRA. Moreover, in terms of accuracy in the LRA language tasks, it performs competitively with Structured State Space Models (SSMs) without any special initialization - outperforming Transformers by a large margin. On the other hand, while SSMs can marginally outperform RIR on LRA, they (SSMs) fail to length-generalize on ListOps. Our code is available at: \url{https://github.com/JRC1995/BeamRecursionFamily/}.


title: The existence of inversive distance circle packing on hyperbolic polyhedral surface

abstract: In this paper, we prove that given a hyperbolic polyhedral metric with an inversive distance circle packing, and a target discrete curvature satisfying Gauss-Bonnet formula, there exist a unique inversive distance circle packing which is discrete conformal to the former one. We deform the surface by discrete Ricci flow, and do surgery by edge flipping when the orthogonal circles of some faces are about to be non-compact. The revised weighted Delaunay inequality of hyperbolic case implies the compactness of the orthogonal circle. We use a variational principle of a convex Ricci potential defined on the fiber bundles with cell-decomposition and differential structure based on Teichm\"uller space to finish the proof.


title: Pseduo-Random and de Bruijn Array Codes

abstract: Pseudo-random arrays and perfect maps are the two-dimensional analogs of M-sequences and de Bruijn sequences, respectively. We modify the definitions to be applied to codes. These codes are also the two-dimensional analogs of certain factors in the de Bruijn graph. These factors are called zero factors and perfect factors in the de Bruijn graph. We apply a folding technique to construct pseudo-random array codes and examine the minimum distance of the constructed codes. The folding is applied on sequences generated from irreducible polynomials or a product of irreducible polynomials with the same degree and the same exponent. Direct and recursive constructions for de Bruijn array codes are presented and discussed.


title: Cytoplasmic stirring by active carpets

abstract: Large cells often rely on cytoplasmic flows for intracellular transport, maintaining homeostasis, and positioning cellular components. Understanding the mechanisms of these flows is essential for gaining insights into cell function, developmental processes, and evolutionary adaptability. Here, we focus on a class of self-organized cytoplasmic stirring mechanisms that result from fluid-structure interactions between cytoskeletal elements at the cell cortex. Drawing inspiration from streaming flows in late-stage fruit fly oocytes, we propose an analytically tractable active carpet theory. This model deciphers the origins and three-dimensional spatio-temporal organization of such flows. Through a combination of simulations and weakly nonlinear theory, we establish the pathway of the streaming flow to its global attractor: a cell-spanning vortical twister. Our study reveals the inherent symmetries of this emergent flow, its low-dimensional structure, and illustrates how complex fluid-structure interaction aligns with classical solutions in Stokes flow. This framework can be easily adapted to elucidate a broad spectrum of self-organized, cortex-driven intracellular flows.


title: Lewis's Signaling Game as beta-VAE For Natural Word Lengths and Segments

abstract: As a sub-discipline of evolutionary and computational linguistics, emergent communication (EC) studies communication protocols, called emergent languages, arising in simulations where agents communicate. A key goal of EC is to give rise to languages that share statistical properties with natural languages. In this paper, we reinterpret Lewis's signaling game, a frequently used setting in EC, as beta-VAE and reformulate its objective function as ELBO. Consequently, we clarify the existence of prior distributions of emergent languages and show that the choice of the priors can influence their statistical properties. Specifically, we address the properties of word lengths and segmentation, known as Zipf's law of abbreviation (ZLA) and Harris's articulation scheme (HAS), respectively. It has been reported that the emergent languages do not follow them when using the conventional objective. We experimentally demonstrate that by selecting an appropriate prior distribution, more natural segments emerge, while suggesting that the conventional one prevents the languages from following ZLA and HAS.


title: Influencing Incidental Human-Robot Encounters: Expressive movement improves pedestrians' impressions of a quadruped service robot

abstract: A single mobile service robot may generate hundreds of encounters with pedestrians, yet there is little published data on the factors influencing these incidental human-robot encounters. We report the results of a between-subjects experiment (n=222) testing the impact of robot body language, defined as non-functional modifications to robot movement, upon incidental pedestrian encounters with a quadruped service robot in a real-world setting. We find that canine-inspired body language had a positive influence on participants' perceptions of the robot compared to the robot's stock movement. This effect was visible across all questions of a questionnaire on the perceptions of robots (Godspeed). We argue that body language is a promising and practical design space for improving pedestrian encounters with service robots.


title: Vector-Valued Gossip over $w$-Holonomic Networks

abstract: We study the weighted average consensus problem for a gossip network of agents with vector-valued states. For a given matrix-weighted graph, the gossip process is described by a sequence of pairs of adjacent agents communicating and updating their states based on the edge matrix weight. Our key contribution is providing conditions for the convergence of this non-homogeneous Markov process as well as the characterization of its limit set. To this end, we introduce the notion of "$w$-holonomy" of a set of stochastic matrices, which enables the characterization of sequences of gossiping pairs resulting in reaching a desired consensus in a decentralized manner. Stated otherwise, our result characterizes the limiting behavior of infinite products of (non-commuting, possibly with absorbing states) stochastic matrices.


title: (Social) Trouble on the Road: Understanding and Addressing Social Discomfort in Shared Car Trips

abstract: Unpleasant social interactions on the road can negatively affect driving safety. At the same time, researchers have attempted to address social discomfort by exploring Conversational User Interfaces (CUIs) as social mediators. Before knowing whether CUIs could reduce social discomfort in a car, it is necessary to understand the nature of social discomfort in shared rides. To this end, we recorded nine families going on drives and performed interaction analysis on this data. We define three strategies to address social discomfort: contextual mediation, social mediation, and social support. We discuss considerations for engineering and design, and explore the limitations of current large language models in addressing social discomfort on the road.


title: Evaluating Uncertainty Quantification approaches for Neural PDEs in scientific applications

abstract: The accessibility of spatially distributed data, enabled by affordable sensors, field, and numerical experiments, has facilitated the development of data-driven solutions for scientific problems, including climate change, weather prediction, and urban planning. Neural Partial Differential Equations (Neural PDEs), which combine deep learning (DL) techniques with domain expertise (e.g., governing equations) for parameterization, have proven to be effective in capturing valuable correlations within spatiotemporal datasets. However, sparse and noisy measurements coupled with modeling approximation introduce aleatoric and epistemic uncertainties. Therefore, quantifying uncertainties propagated from model inputs to outputs remains a challenge and an essential goal for establishing the trustworthiness of Neural PDEs. This work evaluates various Uncertainty Quantification (UQ) approaches for both Forward and Inverse Problems in scientific applications. Specifically, we investigate the effectiveness of Bayesian methods, such as Hamiltonian Monte Carlo (HMC) and Monte-Carlo Dropout (MCD), and a more conventional approach, Deep Ensembles (DE). To illustrate their performance, we take two canonical PDEs: Burger's equation and the Navier-Stokes equation. Our results indicate that Neural PDEs can effectively reconstruct flow systems and predict the associated unknown parameters. However, it is noteworthy that the results derived from Bayesian methods, based on our observations, tend to display a higher degree of certainty in their predictions as compared to those obtained using the DE. This elevated certainty in predictions suggests that Bayesian techniques might underestimate the true underlying uncertainty, thereby appearing more confident in their predictions than the DE approach.

categories: cs.LG cs.AI physics.comp-ph physics.flu-dyn


title: Retargeting video with an end-to-end framework

abstract: Video holds significance in computer graphics applications. Because of the heterogeneous of digital devices, retargeting videos becomes an essential function to enhance user viewing experience in such applications. In the research of video retargeting, preserving the relevant visual content in videos, avoiding flicking, and processing time are the vital challenges. Extending image retargeting techniques to the video domain is challenging due to the high running time. Prior work of video retargeting mainly utilizes time-consuming preprocessing to analyze frames. Plus, being tolerant of different video content, avoiding important objects from shrinking, and the ability to play with arbitrary ratios are the limitations that need to be resolved in these systems requiring investigation. In this paper, we present an end-to-end RETVI method to retarget videos to arbitrary aspect ratios. We eliminate the computational bottleneck in the conventional approaches by designing RETVI with two modules, content feature analyzer (CFA) and adaptive deforming estimator (ADE). The extensive experiments and evaluations show that our system outperforms previous work in quality and running time. Visit our project website for more results at http://graphics.csie.ncku.edu.tw/RETVI.


title: Improving Pacing in Long-Form Story Planning

abstract: Existing LLM-based systems for writing long-form stories or story outlines frequently suffer from unnatural pacing, whether glossing over important events or over-elaborating on insignificant details, resulting in a jarring experience for the reader. We propose a CONCrete Outline ConTrol (CONCOCT) system to improve pacing when automatically generating story outlines. We first train a concreteness evaluator to judge which of two events is more concrete (low-level-detailed). This evaluator can then be used to control pacing in hierarchical outline generation; in this work, we explore a vaguest-first expansion procedure that aims for uniform pacing. We further use the evaluator to filter new outline items based on predicted concreteness. Compared to a baseline hierarchical outline generator, humans judge CONCOCT's pacing to be more consistent over 57% of the time across multiple outline lengths; the gains also translate to downstream stories. All code, data, and models are open-sourced.


title: Nanorod Size Dependence of Coherent Coupling between Individual and Collective Excitations via Transverse Electromagnetic Field

abstract: Plasmon is a collective excitation in metals formed through the Coulomb interaction between individual excitations of electron-hole pairs. In many previous studies on the plasmonic response, the role of the longitudinal field has been focused almost exclusively on the light-induced plasmonic phenomena, e.g., hot-carrier generation. In our previous study [Phys. Rev. B 105, 165408 (2022)], we have revealed the significant contribution of the transverse electromagnetic field to connect plasmons and electron-hole pairs in nanostructures based on the self-consistent and nonlocal response theory. In this study, we examine how this contribution appears depending on the system parameters, e.g., length and refractive index. The elucidation of roles of coherent coupling between the collective and individual excitations by the transverse field will lead to the principle of controlling bidirectional energy transfer between the plasmons and electron-hole pairs, which could significantly enhance hot-carrier generation efficiency.


title: Hydrogen diffusion in the lower mantle revealed by machine learning potentials

abstract: Hydrogen may be incorporated into nominally anhydrous minerals including bridgmanite and post-perovskite as defects, making the Earth's deep mantle a potentially significant water reservoir. The diffusion of hydrogen and its contribution to the electrical conductivity in the lower mantle are rarely explored and remain largely unconstrained. Here we calculate hydrogen diffusivity in hydrous bridgmanite and post-perovskite, using molecular dynamics simulations driven by machine learning potentials of ab initio quality. Our findings reveal that hydrogen diffusivity significantly increases with increasing temperature and decreasing pressure, and is considerably sensitive to hydrogen incorporation mechanism. Among the four defect mechanisms examined, (Mg + 2H)$_{\rm Si}$ and (Al + H)$_{\rm Si}$ show similar patterns and yield the highest hydrogen diffusivity. Hydrogen diffusion is generally faster in post-perovskite than in bridgmanite, and these two phases exhibit distinct diffusion anisotropies. Overall, hydrogen diffusion is slow on geological time scales and may result in heterogeneous water distribution in the lower mantle. Additionally, the proton conductivity of bridgmanite for (Mg + 2H)$_{\rm Si}$ and (Al + H)$_{\rm Si}$ defects aligns with the same order of magnitude of lower mantle conductivity, suggesting that the water distribution in the lower mantle may be inferred by examining the heterogeneity of electrical conductivity.


title: The decay contribution to the parity-odd fragmentation functions

abstract: Parity violation in QCD is a consequence of the so-called QCD $\theta$-vacuum. As a result, parity-odd fragmentation functions are introduced and they bring in new observables in the back-to-back dihadron productions in $e^+e^-$-annihilation experiments [Phys.Rev.Lett. 106 (2011) 042001]. The experimental measurements on the corresponding parity-odd fragmentation functions can shed light on the local CP violation effect in QCD. On the other hand, the weak interaction also violates the parity symmetry. Therefore, the weak decay of heavier hadrons can also contribute to the parity-odd effects in fragmentation functions. In this paper, we investigate the weak decay contribution to these parity-odd fragmentation functions and compute their contribution to these new observables. In principle, the decay contribution should/can be excluded in the theoretical analysis and experimental measurements. However, this is usually not the common practice so far. Furthermore, in light of that the value of the $\theta$-parameter is extremely small ($\theta < 3 \times 10^{-10}$), the weak-parity-violating contributions become an important background in identifying the strong-parity-violating term. In this paper, we focus on the weak decay contribution of parity-odd fragmentation functions and demonstrate their sizable contribution in a numerical estimate.


title: Bases for Riemann--Roch spaces of linearized function fields with applications to generalized algebraic geometry codes

abstract: In this paper, we determine explicit bases for Riemann--Roch spaces of linearized function fields, and we give a lower bound for the minimum distance of generalized algebraic geometry codes. As a consequence, we construct generalized algebraic geometry codes with good parameters.


title: Enhancing Few-shot CLIP with Semantic-Aware Fine-Tuning

abstract: Learning generalized representations from limited training samples is crucial for applying deep neural networks in low-resource scenarios. Recently, methods based on Contrastive Language-Image Pre-training (CLIP) have exhibited promising performance in few-shot adaptation tasks. To avoid catastrophic forgetting and overfitting caused by few-shot fine-tuning, existing works usually freeze the parameters of CLIP pre-trained on large-scale datasets, overlooking the possibility that some parameters might not be suitable for downstream tasks. To this end, we revisit CLIP's visual encoder with a specific focus on its distinctive attention pooling layer, which performs a spatial weighted-sum of the dense feature maps. Given that dense feature maps contain meaningful semantic information, and different semantics hold varying importance for diverse downstream tasks (such as prioritizing semantics like ears and eyes in pet classification tasks rather than side mirrors), using the same weighted-sum operation for dense features across different few-shot tasks might not be appropriate. Hence, we propose fine-tuning the parameters of the attention pooling layer during the training process to encourage the model to focus on task-specific semantics. In the inference process, we perform residual blending between the features pooled by the fine-tuned and the original attention pooling layers to incorporate both the few-shot knowledge and the pre-trained CLIP's prior knowledge. We term this method as Semantic-Aware FinE-tuning (SAFE). SAFE is effective in enhancing the conventional few-shot CLIP and is compatible with the existing adapter approach (termed SAFE-A).


title: Solving High Frequency and Multi-Scale PDEs with Gaussian Processes

abstract: Machine learning based solvers have garnered much attention in physical simulation and scientific computing, with a prominent example, physics-informed neural networks (PINNs). However, PINNs often struggle to solve high-frequency and multi-scale PDEs, which can be due to spectral bias during neural network training. To address this problem, we resort to the Gaussian process (GP) framework. To flexibly capture the dominant frequencies, we model the power spectrum of the PDE solution with a student $t$ mixture or Gaussian mixture. We apply the inverse Fourier transform to obtain the covariance function (by Wiener-Khinchin theorem). The covariance derived from the Gaussian mixture spectrum corresponds to the known spectral mixture kernel. Next, we estimate the mixture weights in the log domain, which we show is equivalent to placing a Jeffreys prior. It automatically induces sparsity, prunes excessive frequencies, and adjusts the remaining toward the ground truth. Third, to enable efficient and scalable computation on massive collocation points, which are critical to capture high frequencies, we place the collocation points on a grid, and multiply our covariance function at each input dimension. We use the GP conditional mean to predict the solution and its derivatives so as to fit the boundary condition and the equation itself. As a result, we can derive a Kronecker product structure in the covariance matrix. We use Kronecker product properties and multilinear algebra to promote computational efficiency and scalability, without low-rank approximations. We show the advantage of our method in systematic experiments. The code is released at \url{https://github.com/xuangu-fang/Gaussian-Process-Slover-for-High-Freq-PDE}.


title: Dynamics of causal hydrodynamic fluctuations in an expanding system

abstract: We develop a framework of causal hydrodynamic fluctuations in one-dimensional expanding system performing linearisation of the hydrodynamic equations around the boost invariant solution. Through the description of space-time evolution of thermodynamic variables and flow velocity, we find a novel phenomenon that the structure of thermodynamic variables is almost frozen. We also show that two-particle correlation functions of final hadrons after freezeout are closely related with the mass of hadrons and properties of the medium such as viscosity, relaxation time and equation of state.


title: RDGCN: Reinforced Dependency Graph Convolutional Network for Aspect-based Sentiment Analysis

abstract: Aspect-based sentiment analysis (ABSA) is dedicated to forecasting the sentiment polarity of aspect terms within sentences. Employing graph neural networks to capture structural patterns from syntactic dependency parsing has been confirmed as an effective approach for boosting ABSA. In most works, the topology of dependency trees or dependency-based attention coefficients is often loosely regarded as edges between aspects and opinions, which can result in insufficient and ambiguous syntactic utilization. To address these problems, we propose a new reinforced dependency graph convolutional network (RDGCN) that improves the importance calculation of dependencies in both distance and type views. Initially, we propose an importance calculation criterion for the minimum distances over dependency trees. Under the criterion, we design a distance-importance function that leverages reinforcement learning for weight distribution search and dissimilarity control. Since dependency types often do not have explicit syntax like tree distances, we use global attention and mask mechanisms to design type-importance functions. Finally, we merge these weights and implement feature aggregation and classification. Comprehensive experiments on three popular datasets demonstrate the effectiveness of the criterion and importance functions. RDGCN outperforms state-of-the-art GNN-based baselines in all validations.


title: A human brain atlas of chi-separation for normative iron and myelin distributions

abstract: Iron and myelin are primary susceptibility sources in the human brain. These substances are essential for healthy brain, and their abnormalities are often related to various neurological disorders. Recently, an advanced susceptibility mapping technique, which is referred to as chi-separation, has been proposed, successfully disentangling paramagnetic iron from diamagnetic myelin. This method opened a potential for generating high resolution iron and myelin maps in the brain. Utilizing this technique, this study constructs a normative chi-separation atlas from 106 healthy human brains. The resulting atlas provides detailed anatomical structures associated with the distributions of iron and myelin, clearly delineating subcortical nuclei, thalamic nuclei, and white matter fiber bundles. Additionally, susceptibility values in a number of regions of interest are reported along with age-dependent changes. This atlas may have direct applications such as localization of subcortical structures for deep brain stimulation or high-intensity focused ultrasound and also serve as a valuable resource for future research.


title: Kekul\'e valence bond order in the Hubbard model on the honeycomb lattice with possible lattice distortions for graphene

abstract: We investigate if and how the valence-bond-solid (VBS) state emerges in the Hubbard model on the honeycomb lattice when the Peierls-type electron-lattice coupling is introduced. We consider all possible lattice-distortion patterns allowed for this lattice model for graphene which preserve the reflection symmetry and determine the most stable configuration in the adiabatic limit by using an unbiased quantum Monte Carlo method. The VBS phase with Kekul\'e dimerization is found to appear as an intermediate phase between a semimetal and an antiferromagnetic Mott insulator for a moderately rigid lattice. This implies that the undistorted semimetallic graphene can be driven into the VBS phase by applying strain, accompanied by the single-particle excitation gap opening.


title: Determina\c{c}\~ao da Dist\^ancia \`a Grande Nuvem de Magalh\~aes Atrav\'es das Estrelas Vari\'aveis Cefeidas Dispon\'iveis no Cat\'alogo OGLE-IV

abstract: In this work, we discuss the determination of the distance to the Large Magellanic Cloud (LMC) using the Leavitt Law, utilizing the public catalog of Classical Cepheid Variable stars from the observational project OGLE-IV (The Optical Gravitational Lensing Experiment Collection of Variable Stars), consisting of 4709 stars in the Large Magellanic Cloud. To determine the pulsation period of Cepheid Variable stars, we employ the computational algorithm \textit{Lomb-Scargle periodogram} modified for our data. Additionally, with the calculation of the period, we can derive a period-luminosity relation for Cepheid Variables in the Large Magellanic Cloud and, using an independent calibration distance, deduce their distance moduli. We also discuss some general theoretical concepts of the physical mechanism behind the oscillation of variable stars.


title: Multiple blowing-up solutions for a slightly critical Lane-Emden system with non-power nonlinearity

abstract: In this paper, we study the following Lane-Emden system with nearly critical non-power nonlinearity \begin{eqnarray*} \left\{ \arraycolsep=1.5pt \begin{array}{lll} -\Delta u =\frac{|v|^{p-1}v}{[\ln(e+|v|)]^\epsilon}\ \ &{\rm in}\ \Omega, \\[2mm] -\Delta v =\frac{|u|^{q-1}u}{[\ln(e+|u|)]^\epsilon}\ \ &{\rm in}\ \Omega, \\[2mm] u= v=0 \ \ & {\rm on}\ \partial\Omega, \end{array} \right. \end{eqnarray*} where $\Omega$ is a bounded smooth domain in $\mathbb{R}^N$, $N\geq 3$, $\epsilon>0$ is a small parameter, $p$ and $q $ lying on the critical Sobolev hyperbola $\frac{1}{p+1}+\frac{1}{q+1}=\frac{N-2}{N}$. We construct multiple blowing-up solutions based on the finite dimensional Lyapunov-Schmidt reduction method as $\epsilon$ goes to zero.


title: Autonomous Advanced Aerial Mobility -- An End-to-end Autonomy Framework for UAVs and Beyond

abstract: Developing aerial robots that can both safely navigate and execute assigned mission without any human intervention - i.e., fully autonomous aerial mobility of passengers and goods - is the larger vision that guides the research, design, and development efforts in the aerial autonomy space. However, it is highly challenging to concurrently operationalize all types of aerial vehicles that are operating fully autonomously sharing the airspace. Full autonomy of the aerial transportation sector includes several aspects, such as design of the technology that powers the vehicles, operations of multi-agent fleets, and process of certification that meets stringent safety requirements of aviation sector. Thereby, Autonomous Advanced Aerial Mobility is still a vague term and its consequences for researchers and professionals are ambiguous. To address this gap, we present a comprehensive perspective on the emerging field of autonomous advanced aerial mobility, which involves the use of unmanned aerial vehicles (UAVs) and electric vertical takeoff and landing (eVTOL) aircraft for various applications, such as urban air mobility, package delivery, and surveillance. The article proposes a scalable and extensible autonomy framework consisting of four main blocks: sensing, perception, planning, and controls. Furthermore, the article discusses the challenges and opportunities in multi-agent fleet operations and management, as well as the testing, validation, and certification aspects of autonomous aerial systems. Finally, the article explores the potential of monolithic models for aerial autonomy and analyzes their advantages and limitations. The perspective aims to provide a holistic picture of the autonomous advanced aerial mobility field and its future directions.


title: All-Optical Phase Conjugation Using Diffractive Wavefront Processing

abstract: Optical phase conjugation (OPC) is a nonlinear technique used for counteracting wavefront distortions, with various applications ranging from imaging to beam focusing. Here, we present the design of a diffractive wavefront processor to approximate all-optical phase conjugation operation for input fields with phase aberrations. Leveraging deep learning, a set of passive diffractive layers was optimized to all-optically process an arbitrary phase-aberrated coherent field from an input aperture, producing an output field with a phase distribution that is the conjugate of the input wave. We experimentally validated the efficacy of this wavefront processor by 3D fabricating diffractive layers trained using deep learning and performing OPC on phase distortions never seen by the diffractive processor during its training. Employing terahertz radiation, our physical diffractive processor successfully performed the OPC task through a shallow spatially-engineered volume that axially spans tens of wavelengths. In addition to this transmissive OPC configuration, we also created a diffractive phase-conjugate mirror by combining deep learning-optimized diffractive layers with a standard mirror. Given its compact, passive and scalable nature, our diffractive wavefront processor can be used for diverse OPC-related applications, e.g., turbidity suppression and aberration correction, and is also adaptable to different parts of the electromagnetic spectrum, especially those where cost-effective wavefront engineering solutions do not exist.


title: Emergent Communication for Rules Reasoning

abstract: Research on emergent communication between deep-learning-based agents has received extensive attention due to its inspiration for linguistics and artificial intelligence. However, previous attempts have hovered around emerging communication under perception-oriented environmental settings, that forces agents to describe low-level perceptual features intra image or symbol contexts. In this work, inspired by the classic human reasoning test (namely Raven's Progressive Matrix), we propose the Reasoning Game, a cognition-oriented environment that encourages agents to reason and communicate high-level rules, rather than perceived low-level contexts. Moreover, we propose 1) an unbiased dataset (namely rule-RAVEN) as a benchmark to avoid overfitting, 2) and a two-stage curriculum agent training method as a baseline for more stable convergence in the Reasoning Game, where contexts and semantics are bilaterally drifting. Experimental results show that, in the Reasoning Game, a semantically stable and compositional language emerges to solve reasoning problems. The emerged language helps agents apply the extracted rules to the generalization of unseen context attributes, and to the transfer between different context attributes or even tasks.


title: Portfolio Construction using Black-Litterman Model and Factors

abstract: This paper presents a portfolio construction process, including mainly two parts, Factors Selection and Weight Allocations. For the factors selection part, We have chosen 20 factors by considering three aspects, the global market, different assets class, and stock idiosyncratic characteristics. Each factor is proxied by a corresponding ETF. Then, we would apply several weight allocation methods to those factors, including two fixed weight allocation methods, three optimisation methods, and a Black-Litterman model. In addition, we would also fit a Deep Learning model for generating views periodically and incorporating views with the prior to achieve dynamically updated weights by using the Black-Litterman model. In the end, the robustness checking shows how weights change with respect to time evolving and variance increasing. Results using shrinkage variance are provided to alleviate the impacts of representativeness of historical data, but there sadly has little impact. Overall, the model by using the Deep Learning plus Black-Litterman model results outperform the portfolio by other weight allocation schemes, even though further improvement and robustness checking should be performed.


title: Partial stabilization of nonlinear systems along a given trajectory

abstract: In this paper, the problem of partial stabilization of nonlinear systems along a given trajectory is considered. This problem is treated within the framework of stability of a family of sets. Sufficient conditions for the asymptotic stability of a one-parameter family of sets using time-dependent control in the form of trigonometric polynomials are derived. The obtained results are applied to a model mechanical system.


title: PLV-IEKF: Consistent Visual-Inertial Odometry using Points, Lines, and Vanishing Points

abstract: In this paper, we propose an Invariant Extended Kalman Filter (IEKF) based Visual-Inertial Odometry (VIO) using multiple features in man-made environments. Conventional EKF-based VIO usually suffers from system inconsistency and angular drift that naturally occurs in feature-based methods. However, in man-made environments, notable structural regularities, such as lines and vanishing points, offer valuable cues for localization. To exploit these structural features effectively and maintain system consistency, we design a right invariant filter-based VIO scheme incorporating point, line, and vanishing point features. We demonstrate that the conventional additive error definition for point features can also preserve system consistency like the invariant error definition by proving a mathematically equivalent measurement model. And a similar conclusion is established for line features. Additionally, we conduct an invariant filter-based observability analysis proving that vanishing point measurement maintains unobservable directions naturally. Both simulation and real-world tests are conducted to validate our methods' pose accuracy and consistency. The experimental results validate the competitive performance of our method, highlighting its ability to deliver accurate and consistent pose estimation in man-made environments.


title: Mixed causality graphs for continuous-time state space models and orthogonal projections

abstract: In this paper we derive (local) causality graphs for the popular continuous-time state space models, including in particular multivariate continuous-time ARMA (MCARMA) processes. In these (local) causality graphs, vertices represent the components of the process, directed edges between the vertices indicate causal influences, and undirected edges indicate contemporaneous uncorrelatednesses between the component processes. We present sufficient criteria for state space models to satisfy the assumptions of Fasen-Hartmann and Schenk (2023) so that the (local) causality graphs are well defined and various causal Markov properties hold. Both directed and undirected edges in these graphs are characterised by orthogonal projections on well-defined linear spaces. To compute these orthogonal projections, we use the unique controller canonical form of a state space model, which exists under mild assumptions, to recover the input process from the output process. We are then able to derive some alternative representations of the output process and its highest derivative. Finally, we apply these representations to calculate the necessary orthogonal projections, which culminate in the characterisations of the edges in the (local) causality graph. These characterisations are interpretatively meaningful and are given by the parameters of the controller canonical form and the covariance matrix of the driving L\'evy process.


title: Twitter Sentiment Analysis of Covid Vacciness

abstract: In this paper, we look at a database of tweets sorted by various keywords that could indicate the users sentiment towards covid vaccines. With social media becoming such a prevalent source of opinion, sorting and ranking tweets that hold important information such as opinions on covid vaccines is of utmost importance. Two different ranking scales were used, and ranking a tweet in this way could represent the difference between an opinion being lost and an opinion being featured on the site, which affects the decisions and behavior of people, and why researchers were interested in it. Using natural language processing techniques, our aim is to determine and categorize opinions about covid vaccines with the highest accuracy possible.


title: CLearViD: Curriculum Learning for Video Description

abstract: Video description entails automatically generating coherent natural language sentences that narrate the content of a given video. We introduce CLearViD, a transformer-based model for video description generation that leverages curriculum learning to accomplish this task. In particular, we investigate two curriculum strategies: (1) progressively exposing the model to more challenging samples by gradually applying a Gaussian noise to the video data, and (2) gradually reducing the capacity of the network through dropout during the training process. These methods enable the model to learn more robust and generalizable features. Moreover, CLearViD leverages the Mish activation function, which provides non-linearity and non-monotonicity and helps alleviate the issue of vanishing gradients. Our extensive experiments and ablation studies demonstrate the effectiveness of the proposed model. The results on two datasets, namely ActivityNet Captions and YouCook2, show that CLearViD significantly outperforms existing state-of-the-art models in terms of both accuracy and diversity metrics.


title: Negative frequencies and negative norms in analogue Hawking radiation systems

abstract: In this work, we study the core concepts of Hawking radiation in the astrophysical and analogue systems. We focus on the definitions of negative frequencies and negative norms: their relationship and their role in the particle creation process of the Hawking effect. We characterize the dispersion relation by the signs of the frequency and the norm. We conclude that the most natural frame for studying the Hawking effect is in the frame in which the horizon is static, where the sign of the norm can be made equal to the sign of the Doppler-shifted frequency in that frame. We use as examples the four most successful experimental analogue systems: water waves, Bose-Einstein condensates, polaritons fluids, and optical fibers.


title: Optimizing Distributed Networking with Big Data Scheduling and Cloud Computing

abstract: With the rapid transformation of computer hardware and algorithms, mobile networking has evolved from low data carrying capacity and high latency to better-optimized networks, either by enhancing the digital network or using different approaches to reduce network traffic. This paper discusses the big data applications and scheduling in the distributed networking and analyzes the opportunities and challenges of data management systems. The analysis shows that the big data scheduling in the cloud computing environment produces the most efficient way to transfer and synchronize data. Since scheduling problems and cloud models are very complex to analyze in different settings, we set it to the typical software defined networks. The development of cloud management models and coflow scheduling algorithm is proved to be the priority of the digital communications and networks development in the future.


title: Cross-Domain Dual-Functional OFDM Waveform Design for Accurate Sensing/Positioning

abstract: Orthogonal frequency division multiplexing (OFDM) has been widely recognized as the representative waveform for 5G wireless networks, which can directly support sensing/positioning with existing infrastructure. To guarantee superior sensing/positioning accuracy while supporting high-speed communications simultaneously, the dual functions tend to be assigned with different resource elements (REs) due to their diverse design requirements. This motivates optimization of resource allocation/waveform design across time, frequency, power and delay-Doppler domains. Therefore, this article proposes two cross-domain waveform optimization strategies for effective convergence of OFDM-based communications and sensing/positioning, following communication- and sensing-centric criteria, respectively. For the communication-centric design, to maximize the achievable data rate, a fraction of REs are optimally allocated for communications according to prior knowledge of the communication channel. The remaining REs are then employed for sensing/positioning, where the sidelobe level and peak-to-average power ratio are suppressed by optimizing its power-frequency and phase-frequency characteristics for sensing performance improvement. For the sensing-centric design, a `locally' perfect auto-correlation property is ensured for accurate sensing and positioning by adjusting the unit cells of the ambiguity function within its region of interest (RoI). Afterwards, the irrelevant cells beyond RoI, which can readily determine the sensing power allocation, are optimized with the communication power allocation to enhance the achievable data rate. Numerical results demonstrate the superiority of the proposed waveform designs.


title: Leggett-Garg test of macrorealism using indefinite causal order of measurements

abstract: Macrorealism is a belief that constitutes the core of our perception of reality in the everyday world. The Leggett-Garg (LG) test is a conceptually elegant approach for probing the compatibility between the notion of macrorealism and quantum theory. However, a conclusive LG test hinges on how one fixes the operational invasiveness loophole, i.e., how the statistical form of non-invasive measurability assumption is guaranteed in an LG test. Despite many attempts to close this loophole, no consensus has been achieved yet. In this work, we propose a simple and elegant scheme based on indefinite causal order in quantum switch experiment, which enables us to close this loophole, and eventually, the LG test becomes a conclusive test of macrorealism.


title: Device-independent self-testing of unsharp measurements

abstract: Semi-device-independent certification of an unsharp instrument has recently been demonstrated [New J. Phys. 21, 083034 (2019)] based on the sequential sharing of quantum advantages in a prepare-measure communication game by assuming the system to be qubit. In this work, we provide device-independent (DI) self-testing of the unsharp instrument through the quantum violation of two Bell inequalities where the devices are uncharacterized and the dimension of the system remains unspecified. We introduce an elegant sum-of-squares approach to derive the dimension-independent optimal quantum violation of Bell inequalities which plays a crucial role. Note that the standard Bell test cannot self-test the post-measurement states and consequently cannot self-test unsharp instrument. The sequential Bell test possess the potential to self-test an unsharp instrument. We demonstrate that there exists a trade-off between the maximum sequential quantum violations of the Clauser-Horne-Shimony-Holt inequality, and they form an optimal pair that enables the DI self-testing of the entangled state, the observables, and the unsharpness parameter. Further, we extend our study to the case of elegant Bell inequality and we argue that it has two classical bounds - the local bound and the non-trivial preparation non-contextual bound, lower than the local bound. Based on the sharing of preparation contextuality by three independent sequential observers, we demonstrate the DI self-testing of two unsharpness parameters. Since an actual experimental scenario involves losses and imperfection, we demonstrate robustness of our certification to noise.


title: On the diameter of Engel graphs

abstract: Given a finite group $G$, the Engel graph of $G$ is a directed graph $\Gamma(G)$ encoding pairs of elements satisfying some Engel word. Namely, $\Gamma(G)$ is the directed graph, where the vertices are the non-hypercentral elements of $G$ and where there is an arc from $x$ to $y$ if and only if $[x,_ n y] = 1$ for some $n \in \mathbb{N}$. From previous work, it is known that, except for a few exceptions, $\Gamma(G)$ is strongly connected. In this paper, we give an absolute upper bound on the diameter of $\Gamma(G)$, when $\Gamma(G)$ is strongly connected.


title: Principal specializations of Schubert polynomials, multi-layered permutations and asymptotics

abstract: Let $v(n)$ be the largest principal specialization of Schubert polynomials for layered permutations $v(n) := \max_{w \in \mathcal{L}_n} \mathfrak{S}_w(1,\ldots,1)$. Morales, Pak and Panova proved that there is a limit \[\lim_{n \to \infty} \frac{\log v(n)}{n^2},\] and gave a precise description of layered permutations reaching the maximum. In this paper, we extend Morales Pak and Panova's results to generalized principal specialization $\mathfrak{S}_w(1,q,q^2,\ldots)$ for multi-layered permutations when $q$ equals a root of unity.


title: Monogamy of entanglement and steering in an atom-optomechanical system

abstract: In this article, we theoretically study, in an atomic-optomechanical system, quantum correlations shared between three modes, namely mechanical mode, optical mode and atomic mode. We firstly investigate the combined effect of the variation of the cavity-collective atomic mode coupling and the effective optomechanical one, on the tripartite entanglement behavior as well as on tripartite steering evolution. Then, we discuss pairwise entanglement and bipartite steering according to the aforementioned couplings. Consequently, besides monogamy of the entanglement distribution, the sharing of Gaussian steering is also monogamous, thus the CKW-type monogamy inequalities are fully satisfied under all permutations of the three considered modes in a chosen stable region. In addition, the study of tripartite entanglement and tripartite steering behaviors leads to know the optimal conditions to generate genuine tripartite entanglement, one-way and two-way steering.


title: On the cardinality of irredundant and minimal bases of finite permutation groups

abstract: Given a finite permutation group $G$ with domain $\Omega$, we associate two subsets of natural numbers to $G$, namely $\mathcal{I}(G,\Omega)$ and $\mathcal{M}(G,\Omega)$, which are the sets of cardinalities of all the irredundant and minimal bases of $G$, respectively. We prove that $\mathcal{I}(G)$ is an interval of natural numbers, whereas $\mathcal{M}(G,\Omega)$ may not necessarily form an interval. Moreover, for a given subset of natural numbers $X \subseteq \mathbb{N}$, we provide some conditions on $X$ that ensure the existence of both intransitive and transitive groups $G$ such that $\mathcal{I}(G,\Omega) = X$ and $\mathcal{M}(G,\Omega) = X$.


title: Generalized parity-oblivious communication games powered by quantum preparation contextuality

abstract: The parity-oblivious random-access-code (PORAC) is a class of communication games involving a sender (Alice) and a receiver (Bob). In such games, Alice's amount of communication to Bob is constraint by the parity-oblivious (PO) conditions, so that the parity information of her inputs remains oblivious to Bob. The PO condition in an operational theory is equivalently represented in an ontological model that satisfies the preparation noncontextuality. In this paper, we provide a nontrivial generalization of the existing two-level PORAC and derive the winning probability of the game in the preparation noncontextual ontological model. We demonstrate that the quantum theory outperforms the preparation noncontextual model by predicting higher winning probability in our generalized PORAC.


title: Explainable AI for Earth Observation: Current Methods, Open Challenges, and Opportunities

abstract: Deep learning has taken by storm all fields involved in data analysis, including remote sensing for Earth observation. However, despite significant advances in terms of performance, its lack of explainability and interpretability, inherent to neural networks in general since their inception, remains a major source of criticism. Hence it comes as no surprise that the expansion of deep learning methods in remote sensing is being accompanied by increasingly intensive efforts oriented towards addressing this drawback through the exploration of a wide spectrum of Explainable Artificial Intelligence techniques. This chapter, organized according to prominent Earth observation application fields, presents a panorama of the state-of-the-art in explainable remote sensing image analysis.


title: Sharing nonlocality in a network using the quantum violation of chain network inequality

abstract: Based on the quantum violation of suitable $n$-local inequality in a star network for arbitrary $m$ inputs, we demonstrate the sharing of nonlocality in the network. Such a network features an arbitrary $n$ number of independent sources, $n$ edge parties, and a central party. Each party receives arbitrary $m$ inputs. We consider two different types of sharing of nonlocality in the network. i) The symmetric case - when the sharing of nonlocality is considered across all edge parties. ii) The asymmetric case - when the sharing of nonlocality is considered across only one edge party. For simplicity, we first consider the bilocal scenario $(n=2)$ with three inputs $m=3$ and demonstrate that while in the symmetric case at most two sequential observers can share nonlocality, in the asymmetric case at most four sequential observers can share nonlocality. We extend the study to $n$-local scenario by assuming each party receives three inputs and show that in the symmetric case the result remains the same for any $n$, but in the asymmetrical case, an unbounded number of sequential observers can share nonlocality across one edge for a sufficiently large value of $n$. We further extend our result for arbitrary $m$ input in $n$-local scenario. We demonstrate that for $m\geq 4$, in the symmetric case at most one sequential observer can share nonlocality irrespective of the value of $n$. For the asymmetric case, we analytically show that there exists $n(k)$ for which an arbitrary $k$ number of sequential observers can share the nonlocality across one edge. The optimal quantum violation of $m$-input $n$-local inequality is derived through an elegant SOS approach without specifying the dimension of the quantum system.


title: On conformal biharmonic maps and hypersurfaces

abstract: In this article we initiate a thorough geometric study of the conformal bienergy functional which consists of the standard bienergy augmented by two additional curvature terms. The conformal bienergy is conformally invariant in dimension four and its precise structure is motivated by the Paneitz operator from conformal geometry. The critical points of the conformal bienergy are called conformal biharmonic maps. Besides establishing a number of basic results on conformal biharmonic maps, we pay special attention to conformal biharmonic hypersurfaces in space forms. For hypersurfaces in spheres, we determine all conformal biharmonic hyperspheres and then we classify all conformal biharmonic generalized Clifford tori. Moreover, in sharp contrast to biharmonic hypersurfaces, we show that there also exist conformal biharmonic hypersurfaces of hyperbolic space, pointing out a fundamental difference between biharmonic and conformal biharmonic hypersurfaces. Finally, we also study the stability of the conformal biharmonic hyperspheres in spheres and explicitly compute their index and nullity. In particular, we obtain that the index of the equator $\mathbb{S}^4$ of $\mathbb{S}^5$ is zero, i.e., it is stable, while the index of the equator $\mathbb{S}^5$ of $\mathbb{S}^6$ is seven.


title: Non-Rigid Shape Registration via Deep Functional Maps Prior

abstract: In this paper, we propose a learning-based framework for non-rigid shape registration without correspondence supervision. Traditional shape registration techniques typically rely on correspondences induced by extrinsic proximity, therefore can fail in the presence of large intrinsic deformations. Spectral mapping methods overcome this challenge by embedding shapes into, geometric or learned, high-dimensional spaces, where shapes are easier to align. However, due to the dependency on abstract, non-linear embedding schemes, the latter can be vulnerable with respect to perturbed or alien input. In light of this, our framework takes the best of both worlds. Namely, we deform source mesh towards the target point cloud, guided by correspondences induced by high-dimensional embeddings learned from deep functional maps (DFM). In particular, the correspondences are dynamically updated according to the intermediate registrations and filtered by consistency prior, which prominently robustify the overall pipeline. Moreover, in order to alleviate the requirement of extrinsically aligned input, we train an orientation regressor on a set of aligned synthetic shapes independent of the training shapes for DFM. Empirical results show that, with as few as dozens of training shapes of limited variability, our pipeline achieves state-of-the-art results on several benchmarks of non-rigid point cloud matching, but also delivers high-quality correspondences between unseen challenging shape pairs that undergo both significant extrinsic and intrinsic deformations, in which case neither traditional registration methods nor intrinsic methods work. The code is available at https://github.com/rqhuang88/DFR.


title: Multi-label and Multi-target Sampling of Machine Annotation for Computational Stance Detection

abstract: Data collection from manual labeling provides domain-specific and task-aligned supervision for data-driven approaches, and a critical mass of well-annotated resources is required to achieve reasonable performance in natural language processing tasks. However, manual annotations are often challenging to scale up in terms of time and budget, especially when domain knowledge, capturing subtle semantic features, and reasoning steps are needed. In this paper, we investigate the efficacy of leveraging large language models on automated labeling for computational stance detection. We empirically observe that while large language models show strong potential as an alternative to human annotators, their sensitivity to task-specific instructions and their intrinsic biases pose intriguing yet unique challenges in machine annotation. We introduce a multi-label and multi-target sampling strategy to optimize the annotation quality. Experimental results on the benchmark stance detection corpora show that our method can significantly improve performance and learning efficacy.


title: PersonMAE: Person Re-Identification Pre-Training with Masked AutoEncoders

abstract: Pre-training is playing an increasingly important role in learning generic feature representation for Person Re-identification (ReID). We argue that a high-quality ReID representation should have three properties, namely, multi-level awareness, occlusion robustness, and cross-region invariance. To this end, we propose a simple yet effective pre-training framework, namely PersonMAE, which involves two core designs into masked autoencoders to better serve the task of Person Re-ID. 1) PersonMAE generates two regions from the given image with RegionA as the input and \textit{RegionB} as the prediction target. RegionA is corrupted with block-wise masking to mimic common occlusion in ReID and its remaining visible parts are fed into the encoder. 2) Then PersonMAE aims to predict the whole RegionB at both pixel level and semantic feature level. It encourages its pre-trained feature representations with the three properties mentioned above. These properties make PersonMAE compatible with downstream Person ReID tasks, leading to state-of-the-art performance on four downstream ReID tasks, i.e., supervised (holistic and occluded setting), and unsupervised (UDA and USL setting). Notably, on the commonly adopted supervised setting, PersonMAE with ViT-B backbone achieves 79.8% and 69.5% mAP on the MSMT17 and OccDuke datasets, surpassing the previous state-of-the-art by a large margin of +8.0 mAP, and +5.3 mAP, respectively.


title: Device-independent certification of degeneracy-breaking measurements

abstract: In a device-independent Bell test, the devices are considered to be black boxes and the dimension of the system remains unspecified. The dichotomic observables involved in such a Bell test can be degenerate and one may invoke a suitable measurement scheme to lift the degeneracy. However, the standard Bell test cannot account for whether or up to what extent the degeneracy is lifted, as the effect of lifting the degeneracy can only be reflected in the post-measurement states, which the standard Bell tests do not certify. In this work, we demonstrate the device-independent certification of degeneracy-breaking measurement based on the sequential Bell test by multiple observers who perform degeneracy-breaking unsharp measurements characterized by positive-operator-valued measures (POVMs) - the noisy variants of projectors. The optimal quantum violation of Clauser-Horne-Shimony-Holt inequality by multiple sequential observers eventually enables us to certify up to what extent the degeneracy has been lifted. In particular, our protocol certifies the upper bound on the number of POVMs used for performing such measurements along with the entangled state and measurement observables. We use an elegant sum-of-squares approach that powers such certification of degeneracy-breaking measurements.


title: NExT-Chat: An LMM for Chat, Detection and Segmentation

abstract: The development of large language models (LLMs) has greatly advanced the field of multimodal understanding, leading to the emergence of large multimodal models (LMMs). In order to enhance the level of visual comprehension, recent studies have equipped LMMs with region-level understanding capabilities by representing object bounding box coordinates as a series of text sequences (pix2seq). In this paper, we introduce a novel paradigm for object location modeling called pix2emb method, where we ask the LMM to output the location embeddings and then decode them with different decoders. This paradigm allows us to use different location formats (such as bounding boxes and masks) in multimodal conversations. Leveraging the proposed pix2emb method, we train an LMM named NExT-Chat and demonstrate its capability of handling multiple tasks like visual grounding, region captioning, and grounded reasoning. Comprehensive experiments show the effectiveness of our NExT-Chat on various tasks, e.g., NExT-Chat (87.7) vs. Shikra (86.9) on POPE-Random, NExT-Chat (68.9) vs. LISA (67.9) on referring expression segmentation task, and NExT-Chat (79.6) vs. Kosmos-2 (62.3) on region caption task. The code and model are released at https://github.com/NExT-ChatV/NExT-Chat.


title: Near-Linear Scaling Data Parallel Training with Overlapping-Aware Gradient Compression

abstract: Existing Data Parallel (DP) trainings for deep neural networks (DNNs) often experience limited scalability in speedup due to substantial communication overheads. While Overlapping technique can mitigate such problem by paralleling communication and computation in DP, its effectiveness is constrained by the high communication-to-computation ratios (CCR) of DP training tasks. Gradient compression (GC) is a promising technique to obtain lower CCR by reducing communication volume directly. However, it is challenging to obtain real performance improvement by applying GC into Overlapping because of (1) severe performance penalties in traditional GCs caused by high compression overhead and (2) decline of Overlapping benefit owing to the possible data dependency in GC schemes. In this paper, we propose COVAP, a novel GC scheme designing a new coarse-grained filter, makes the compression overhead close to zero. COVAP ensures an almost complete overlap of communication and computation by employing adaptive compression ratios and tensor sharding tailored to specific training tasks. COVAP also adopts an improved error feedback mechanism to maintain training accuracy. Experiments are conducted on Alibaba Cloud ECS instances with different DNNs of real-world applications. The results illustrate that COVAP outperforms existent GC schemes in time-to-solution by 1.92x-15.39x and exhibits near-linear scaling. Furthermore, COVAP achieves best scalability under experiments on four different cluster sizes.


title: Mie-scattering controlled all-dielectric resonator-antenna for bright and directional point dipole emission

abstract: Designing a deterministic, bright, robust, room temperature stable, on-demand solid-state single photon source has been a major demand in the field of quantum-photonics. For this, various single-photon resonator and antenna schemes are being actively explored. Here, using the Cartesian multi-polar decomposition of the excited Mie-scattering moments, we present the design of a all-dielectric coupled-dipolar antenna comprising of two dielectric (Tin-oxide, TiO$_2$) cylinders sandwiching a nanodiamond based nitrogen-vacancy (NV$^-$) center trapped in a poly-vinyl alcohol (PVA) matrix. The Mie-scattering resonant cavity formed in the middle PVA layer provides more than an order of magnitude decay rate or Purcell enhancement. The balancing of the electric and magnetic dipolar moments (a phenomenon commonly known as the Kerker condition) of the coupled TiO$_2$ cylinders under NV$^-$ dipole excitation, provides significant directionality to the radiation pattern. Using a collection lens with a numerical aperture (NA) of 0.9 the vertical collection efficiency (VCE) was observed to be around 80\% at the NV$^-$ center's zero-phonon line wavelength.


title: PRED: Pre-training via Semantic Rendering on LiDAR Point Clouds

abstract: Pre-training is crucial in 3D-related fields such as autonomous driving where point cloud annotation is costly and challenging. Many recent studies on point cloud pre-training, however, have overlooked the issue of incompleteness, where only a fraction of the points are captured by LiDAR, leading to ambiguity during the training phase. On the other hand, images offer more comprehensive information and richer semantics that can bolster point cloud encoders in addressing the incompleteness issue inherent in point clouds. Yet, incorporating images into point cloud pre-training presents its own challenges due to occlusions, potentially causing misalignments between points and pixels. In this work, we propose PRED, a novel image-assisted pre-training framework for outdoor point clouds in an occlusion-aware manner. The main ingredient of our framework is a Birds-Eye-View (BEV) feature map conditioned semantic rendering, leveraging the semantics of images for supervision through neural rendering. We further enhance our model's performance by incorporating point-wise masking with a high mask ratio (95%). Extensive experiments demonstrate PRED's superiority over prior point cloud pre-training methods, providing significant improvements on various large-scale datasets for 3D perception tasks. Codes will be available at https://github.com/PRED4pc/PRED.


title: TADA: Making Node-link Diagrams Accessible to Blind and Low-Vision People

abstract: Diagrams often appear as node-link representations in many contexts, such as taxonomies, mind maps and networks in textbooks. Despite their pervasiveness, they present significant accessibility challenges for blind and low-vision people. To address this challenge, we introduce Touch-and-Audio-based Diagram Access (TADA), a tablet-based interactive system that makes diagram exploration accessible through musical tones and speech. We designed and developed TADA informed by insights gained from an interview study with 15 participants who shared their challenges and strategies for accessing diagrams. TADA enables people to access a diagram by: i) engaging in open-ended touch-based explorations, ii) allowing searching of specific nodes, iii) navigating from one node to another and iv) filtering information. We evaluated TADA with 25 participants and found that it can be a useful tool for gaining different perspectives about the diagram and participants could complete several diagram-related tasks.


title: Constrained Adaptive Attacks: Realistic Evaluation of Adversarial Examples and Robust Training of Deep Neural Networks for Tabular Data

abstract: State-of-the-art deep learning models for tabular data have recently achieved acceptable performance to be deployed in industrial settings. However, the robustness of these models remains scarcely explored. Contrary to computer vision, there is to date no realistic protocol to properly evaluate the adversarial robustness of deep tabular models due to intrinsic properties of tabular data such as categorical features, immutability, and feature relationship constraints. To fill this gap, we propose CAA, the first efficient evasion attack for constrained tabular deep learning models. CAA is an iterative parameter-free attack that combines gradient and search attacks to generate adversarial examples under constraints. We leverage CAA to build a benchmark of deep tabular models across three popular use cases: credit scoring, phishing and botnet attacks detection. Our benchmark supports ten threat models with increasing capabilities of the attacker, and reflects real-world attack scenarios for each use case. Overall, our results demonstrate how domain knowledge, adversarial training, and attack budgets impact the robustness assessment of deep tabular models and provide security practitioners with a set of recommendations to improve the robustness of deep tabular models against various evasion attack scenarios.


title: X-ray diffraction study of epitaxial CuO nanostructures obtained through post-deposition annealing of Cu on SrTiO$_3$(001)

abstract: Orientation, structure and morphology in the early growth stages of CuO films on strontium titanate were studied by synchrotron radiation X-ray diffraction. Nanostructured CuO films were obtained by ex situ heat treatment at 970 K in oxygen flow at ambient pressure after an initial deposition of Cu on SrTiO$_3$(001) at $10^{-4}$ Pa oxygen pressure using the molecular beam epitaxy technique. These films at low coverages grow forming islands a few tens of nanometers wide, with the [010] direction perpendicular to the substrate surface. Two types of epitaxies are observed, CuO[001]//SrTiO$_3$[100] and CuO[100]//SrTiO$_3$[100], the former being the preferred one. The combination of these epitaxies with the P4mm surface symmetry of the substrate generates 16 different orientations of nanostructures. The lattice constant values obtained from X-ray diffraction are very close to those of bulk tenorite, with the exception of the monoclinic angle $\theta$, which is reduced from 99.54$^\circ$ to 96.76(8)$^\circ$ by the epitaxy constraints. This angle is a key parameter in determining the magnetic properties of CuO.


title: NITEC: Versatile Hand-Annotated Eye Contact Dataset for Ego-Vision Interaction

abstract: Eye contact is a crucial non-verbal interaction modality and plays an important role in our everyday social life. While humans are very sensitive to eye contact, the capabilities of machines to capture a person's gaze are still mediocre. We tackle this challenge and present NITEC, a hand-annotated eye contact dataset for ego-vision interaction. NITEC exceeds existing datasets for ego-vision eye contact in size and variety of demographics, social contexts, and lighting conditions, making it a valuable resource for advancing ego-vision-based eye contact research. Our extensive evaluations on NITEC demonstrate strong cross-dataset performance, emphasizing its effectiveness and adaptability in various scenarios, that allows seamless utilization to the fields of computer vision, human-computer interaction, and social robotics. We make our NITEC dataset publicly available to foster reproducibility and further exploration in the field of ego-vision interaction. https://github.com/thohemp/nitec


title: Minimal Surfaces & the Intermediate State of Type-I Superconductors

abstract: The geometry of the intermediate state (IS) flux structures of type-I superconductors, observed during early stages of magnetic flux penetration induced by an externally applied perpendicular magnetic field, is approached in terms of minimal surfaces. This approach follows from the assumption that a local free energy minimization constraint, for each individual flux structure, dominates for sufficiently spatially separated magnetic flux regions, i.e. when over global free energy minimization predicts very low periodicity of sample intermediate state.


title: Conversation Understanding using Relational Temporal Graph Neural Networks with Auxiliary Cross-Modality Interaction

abstract: Emotion recognition is a crucial task for human conversation understanding. It becomes more challenging with the notion of multimodal data, e.g., language, voice, and facial expressions. As a typical solution, the global- and the local context information are exploited to predict the emotional label for every single sentence, i.e., utterance, in the dialogue. Specifically, the global representation could be captured via modeling of cross-modal interactions at the conversation level. The local one is often inferred using the temporal information of speakers or emotional shifts, which neglects vital factors at the utterance level. Additionally, most existing approaches take fused features of multiple modalities in an unified input without leveraging modality-specific representations. Motivating from these problems, we propose the Relational Temporal Graph Neural Network with Auxiliary Cross-Modality Interaction (CORECT), an novel neural network framework that effectively captures conversation-level cross-modality interactions and utterance-level temporal dependencies with the modality-specific manner for conversation understanding. Extensive experiments demonstrate the effectiveness of CORECT via its state-of-the-art results on the IEMOCAP and CMU-MOSEI datasets for the multimodal ERC task.


title: Moduli Spaces of Instantons in Flag Manifold Sigma Models -- Vortices in Quiver Gauge Theories

abstract: In this paper, we discuss lumps (sigma model instantons) in flag manifold sigma models. In particular, we focus on the moduli space of BPS lumps in general K\"ahler flag manifold sigma models. Such a K\"ahler flag manifold, which takes the form $\frac{U(n_1+\cdots+ n_{L+1})}{U(n_1) \times \cdots \times U(n_{L+1})}$, can be realized as a vacuum moduli space of a $U(N_1) \times \cdots \times U(N_L)$ quiver gauged linear sigma model. When the gauge coupling constants are finite, the gauged linear sigma model admits BPS vortex configurations, which reduce to BPS lumps in the low energy effective sigma model in the large gauge coupling limit. We derive an ADHM-like quotient construction of the moduli space of BPS vortices and lumps by generalizing the quotient construction in $U(N)$ gauge theories by Hanany and Tong. As an application, we check the dualities of the 2d models by computing the vortex partition functions using the quotient construction.


title: Learning Discriminative Features for Crowd Counting

abstract: Crowd counting models in highly congested areas confront two main challenges: weak localization ability and difficulty in differentiating between foreground and background, leading to inaccurate estimations. The reason is that objects in highly congested areas are normally small and high level features extracted by convolutional neural networks are less discriminative to represent small objects. To address these problems, we propose a learning discriminative features framework for crowd counting, which is composed of a masked feature prediction module (MPM) and a supervised pixel-level contrastive learning module (CLM). The MPM randomly masks feature vectors in the feature map and then reconstructs them, allowing the model to learn about what is present in the masked regions and improving the model's ability to localize objects in high density regions. The CLM pulls targets close to each other and pushes them far away from background in the feature space, enabling the model to discriminate foreground objects from background. Additionally, the proposed modules can be beneficial in various computer vision tasks, such as crowd counting and object detection, where dense scenes or cluttered environments pose challenges to accurate localization. The proposed two modules are plug-and-play, incorporating the proposed modules into existing models can potentially boost their performance in these scenarios.


title: Nearly invariant brangesian subspaces

abstract: This article describes Hilbert spaces contractively contained in certain reproducing kernel Hilbert spaces of analytic functions on the open unit disc which are nearly invariant under division by an inner function. We extend Hitt's theorem on nearly invariant subspaces of the backward shift operator on $H^2(\bb D)$ as well as its many generalizations to the setting of de Branges spaces.


title: Solution of FPK Equation for Stochastic Dynamics Subjected to Additive Gaussian Noise via Deep Learning Approach

abstract: The Fokker-Plank-Kolmogorov (FPK) equation is an idealized model representing many stochastic systems commonly encountered in the analysis of stochastic structures as well as many other applications. Its solution thus provides an invaluable insight into the performance of many engineering systems. Despite its great importance, the solution of the FPK equation is still extremely challenging. For systems of practical significance, the FPK equation is usually high dimensional, rendering most of the numerical methods ineffective. In this respect, the present work introduces the FPK-DP Net as a physics-informed network that encodes the physical insights, i.e. the governing constrained differential equations emanated out of physical laws, into a deep neural network. FPK-DP Net is a mesh-free learning method that can solve the density evolution of stochastic dynamics subjected to additive white Gaussian noise without any prior simulation data and can be used as an efficient surrogate model afterward. FPK-DP Net uses the dimension-reduced FPK equation. Therefore, it can be used to address high-dimensional practical problems as well. To demonstrate the potential applicability of the proposed framework, and to study its accuracy and efficacy, numerical implementations on five different benchmark problems are investigated.


title: FFINet: Future Feedback Interaction Network for Motion Forecasting

abstract: Motion forecasting plays a crucial role in autonomous driving, with the aim of predicting the future reasonable motions of traffic agents. Most existing methods mainly model the historical interactions between agents and the environment, and predict multi-modal trajectories in a feedforward process, ignoring potential trajectory changes caused by future interactions between agents. In this paper, we propose a novel Future Feedback Interaction Network (FFINet) to aggregate features the current observations and potential future interactions for trajectory prediction. Firstly, we employ different spatial-temporal encoders to embed the decomposed position vectors and the current position of each scene, providing rich features for the subsequent cross-temporal aggregation. Secondly, the relative interaction and cross-temporal aggregation strategies are sequentially adopted to integrate features in the current fusion module, observation interaction module, future feedback module and global fusion module, in which the future feedback module can enable the understanding of pre-action by feeding the influence of preview information to feedforward prediction. Thirdly, the comprehensive interaction features are further fed into final predictor to generate the joint predicted trajectories of multiple agents. Extensive experimental results show that our FFINet achieves the state-of-the-art performance on Argoverse 1 and Argoverse 2 motion forecasting benchmarks.


title: On the Validity of Credit-Based Shaper Delay Guarantees in Decentralized Reservation Protocols

abstract: Resource reservation is a fundamental mechanism for ensuring quality of service in time-sensitive networks, which can be decentralized by using reservation protocols. In the Ethernet technology Time-Sensitive Networking, this has been proposed in conjunction with the Credit-Based Shaper. For the reservation, the standards assume a maximum worst-case latency bound at each hop. However, we will show through formal analysis and simulation that these worst-case latency bounds are not safe. To face this, we propose an extension to the current standards to allow the reservation of time-sensitive traffic with reliable latency guarantees. The effectiveness of our approach is demonstrated through simulations of both synthetic and industrial networks. Finally, by providing additional information about neighboring devices, we could further increase the maximum reservable traffic by up to 20% in our test cases.


title: Diagnosing Quantum Phases Using Long-Range Two-Site Quantum Resource Behaviors

abstract: We propose and demonstrate that the behaviors of long-range, two-site quantum resources can effectively diagnose quantum phases. In an XX spin chain with symmetry-breaking quantum phase transitions, we reveal that the asymptotic and oscillating decay modes of quantum coherence or quantum discord, along with two-site distance, can identify two spin-liquid phases. Furthermore, based on our analytical results of spin correlation functions, we confirm the existence of long-range entanglement in the system and establish a connection between two-site entanglement and quantum phases. Additionally, for the extended Ising model with topological phase transitions, we find that coherence and quantum discord behaviors can also signify topological quantum phases. In particular, we discover the quantum resource freezing phenomenon, where topologically protected long-range quantum resources may have potential applications in quantum information processing.


title: Tannaka duality and 1-affineness

abstract: We show that Lurie's results on Tannaka duality for geometric stacks hold without any tameness hypotheses. We deduce this as a consequence of an affineness theorem in the theory of sheaves of categories. This affineness result is also applied to the study of tensor product and integral transform formulas for categories of quasicoherent sheaves.


title: Projective symmetry determined topology in flux Su-Schrieffer-Heeger model

abstract: In the field of symmetry-protected topological phases, a common wisdom is that the symmetries fix the topological classifications, but they alone cannot determine whether a system is topologically trivial or not. Here, we show that this is no longer true in cases where symmetries are projectively represented. Particularly, the Zak phase, a topological invariant of a one-dimensional system, can be entirely determined by the projective symmetry algebra (PSA). To demonstrate this remarkable effect, we propose a minimal model, termed as flux Su-Schrieffer-Heeger (SSH) model, where the bond dimerization in the original SSH model is replaced by a flux dimerization. We present experimental realization of our flux SSH model in an electric-circuit array, and our predictions are directly confirmed by experimental measurement. Our work refreshes the understanding of the relation between symmetry and topology, opens up new avenues for exploring PSA determined topological phases, and suggests flux dimerization as a novel approach for designing topological crystals.


title: High-Performance Hybrid Algorithm for Minimum Sum-of-Squares Clustering of Infinitely Tall Data

abstract: This paper introduces a novel formulation of the clustering problem, namely the Minimum Sum-of-Squares Clustering of Infinitely Tall Data (MSSC-ITD), and presents HPClust, an innovative set of hybrid parallel approaches for its effective solution. By utilizing modern high-performance computing techniques, HPClust enhances key clustering metrics: effectiveness, computational efficiency, and scalability. In contrast to vanilla data parallelism, which only accelerates processing time through the MapReduce framework, our approach unlocks superior performance by leveraging the multi-strategy competitive-cooperative parallelism and intricate properties of the objective function landscape. Unlike other available algorithms that struggle to scale, our algorithm is inherently parallel in nature, improving solution quality through increased scalability and parallelism, and outperforming even advanced algorithms designed for small and medium-sized datasets. Our evaluation of HPClust, featuring four parallel strategies, demonstrates its superiority over traditional and cutting-edge methods by offering better performance in the key metrics. These results also show that parallel processing not only enhances the clustering efficiency, but the accuracy as well. Additionally, we explore the balance between computational efficiency and clustering quality, providing insights into optimal parallel strategies based on dataset specifics and resource availability. This research advances our understanding of parallelism in clustering algorithms, demonstrating that a judicious hybridization of advanced parallel approaches yields optimal results for MSSC-ITD. Experiments on synthetic data further confirm HPClust's exceptional scalability and robustness to noise.


title: Towards Democratizing AI: A Comparative Analysis of AI as a Service Platforms and the Open Space for Machine Learning Approach

abstract: Recent AI research has significantly reduced the barriers to apply AI, but the process of setting up the necessary tools and frameworks can still be a challenge. While AI-as-a-Service platforms have emerged to simplify the training and deployment of AI models, they still fall short of achieving true democratization of AI. In this paper, we aim to address this gap by comparing several popular AI-as-a-Service platforms and identifying the key requirements for a platform that can achieve true democratization of AI. Our analysis highlights the need for self-hosting options, high scalability, and openness. To address these requirements, we propose our approach: the "Open Space for Machine Learning" platform. Our platform is built on cutting-edge technologies such as Kubernetes, Kubeflow Pipelines, and Ludwig, enabling us to overcome the challenges of democratizing AI. We argue that our approach is more comprehensive and effective in meeting the requirements of democratizing AI than existing AI-as-a-Service platforms.


title: Synergy Among Flexible Demands: Forming a Coalition to Earn More from Reserve Market

abstract: We address potential synergy among flexible demands and how they may earn more collectively than individually by forming a coalition and bidding to the reserve market. We consider frequency-supporting ancillary service markets, particularly the manual Frequency Restoration Reserve (mFRR) market. The coalition of flexible demands provides more reliable mFRR services, where in comparison to individual demands, is penalized less for their potential failure and is paid more for their successful activation. This synergy effect is quantified as a function of the number of homogeneous assets in the coalition. A subsequent payment allocation mechanism using Shapley values is proposed to distribute the total earnings of the coalition among demands, while incentivizing them to remain in the coalition. For our numerical study, we use real price data from the Danish mFRR market in 2022.


title: Adaptive Mirror Descent Bilevel Optimization

abstract: In the paper, we propose a class of efficient adaptive bilevel methods based on mirror descent for nonconvex bilevel optimization, where its upper-level problem is nonconvex possibly with nonsmooth regularization, and its lower-level problem is also nonconvex while satisfies Polyak-{\L}ojasiewicz (PL) condition. To solve these deterministic bilevel problems, we present an efficient adaptive projection-aid gradient (i.e., AdaPAG) method based on mirror descent, and prove that it obtains the best known gradient complexity of $O(\epsilon^{-1})$ for finding an $\epsilon$-stationary solution of nonconvex bilevel problems. To solve these stochastic bilevel problems, we propose an efficient adaptive stochastic projection-aid gradient (i.e., AdaVSPAG) methods based on mirror descent and variance-reduced techniques, and prove that it obtains the best known gradient complexity of $O(\epsilon^{-3/2})$ for finding an $\epsilon$-stationary solution. Since the PL condition relaxes the strongly convex, our algorithms can be used to nonconvex strongly-convex bilevel optimization. Theoretically, we provide a useful convergence analysis framework for our methods under some mild conditions, and prove that our methods have a fast convergence rate of $O(\frac{1}{T})$, where $T$ denotes the number of iterations.


title: Learning Robust Multi-Scale Representation for Neural Radiance Fields from Unposed Images

abstract: We introduce an improved solution to the neural image-based rendering problem in computer vision. Given a set of images taken from a freely moving camera at train time, the proposed approach could synthesize a realistic image of the scene from a novel viewpoint at test time. The key ideas presented in this paper are (i) Recovering accurate camera parameters via a robust pipeline from unposed day-to-day images is equally crucial in neural novel view synthesis problem; (ii) It is rather more practical to model object's content at different resolutions since dramatic camera motion is highly likely in day-to-day unposed images. To incorporate the key ideas, we leverage the fundamentals of scene rigidity, multi-scale neural scene representation, and single-image depth prediction. Concretely, the proposed approach makes the camera parameters as learnable in a neural fields-based modeling framework. By assuming per view depth prediction is given up to scale, we constrain the relative pose between successive frames. From the relative poses, absolute camera pose estimation is modeled via a graph-neural network-based multiple motion averaging within the multi-scale neural-fields network, leading to a single loss function. Optimizing the introduced loss function provides camera intrinsic, extrinsic, and image rendering from unposed images. We demonstrate, with examples, that for a unified framework to accurately model multiscale neural scene representation from day-to-day acquired unposed multi-view images, it is equally essential to have precise camera-pose estimates within the scene representation framework. Without considering robustness measures in the camera pose estimation pipeline, modeling for multi-scale aliasing artifacts can be counterproductive. We present extensive experiments on several benchmark datasets to demonstrate the suitability of our approach.


title: Long-term Time Series Forecasting based on Decomposition and Neural Ordinary Differential Equations

abstract: Long-term time series forecasting (LTSF) is a challenging task that has been investigated in various domains such as finance investment, health care, traffic, and weather forecasting. In recent years, Linear-based LTSF models showed better performance, pointing out the problem of Transformer-based approaches causing temporal information loss. However, Linear-based approach has also limitations that the model is too simple to comprehensively exploit the characteristics of the dataset. To solve these limitations, we propose LTSF-DNODE, which applies a model based on linear ordinary differential equations (ODEs) and a time series decomposition method according to data statistical characteristics. We show that LTSF-DNODE outperforms the baselines on various real-world datasets. In addition, for each dataset, we explore the impacts of regularization in the neural ordinary differential equation (NODE) framework.


title: $L^p$-$L^q$ estimates for transition semigroups associated to dissipative stochastic systems

abstract: In a separable Hilbert space, we study supercontractivity and ultracontractivity properties for a transition semigroups associated with a stochastic partial differential equations. This is done in terms of exponential integrability of Lipschitz functions and some logarithmic Sobolev-type inequalities with respect to invariant measures. The abstract characterization results concerning the improving of summability can be applied to transition semigroups associated to a stochastic reaction-diffusion equations.


title: Validating ChatGPT Facts through RDF Knowledge Graphs and Sentence Similarity

abstract: Since ChatGPT offers detailed responses without justifications, and erroneous facts even for popular persons, events and places, in this paper we present a novel pipeline that retrieves the response of ChatGPT in RDF and tries to validate the ChatGPT facts using one or more RDF Knowledge Graphs (KGs). To this end we leverage DBpedia and LODsyndesis (an aggregated Knowledge Graph that contains 2 billion triples from 400 RDF KGs of many domains) and short sentence embeddings, and introduce an algorithm that returns the more relevant triple(s) accompanied by their provenance and a confidence score. This enables the validation of ChatGPT responses and their enrichment with justifications and provenance. To evaluate this service (such services in general), we create an evaluation benchmark that includes 2,000 ChatGPT facts; specifically 1,000 facts for famous Greek Persons, 500 facts for popular Greek Places, and 500 facts for Events related to Greece. The facts were manually labelled (approximately 73% of ChatGPT facts were correct and 27% of facts were erroneous). The results are promising; indicatively for the whole benchmark, we managed to verify the 85.3% of the correct facts of ChatGPT and to find the correct answer for the 58% of the erroneous ChatGPT facts.


title: Motion of microswimmers in cylindrical microchannels

abstract: Biological and artificial microswimmers often have to propel through a variety of environments, ranging from heterogeneous suspending media to strong geometrical confinement. Under confinement, local flow fields generated by microswimmers, and steric and hydrodynamic interactions with their environment determine the locomotion. We propose a squirmer-like model to describe the motion of microswimmers in cylindrical microchannels, where propulsion is generated by a fixed surface slip velocity. The model is studied analytically for cylindrical swimmer shapes, and by numerical hydrodynamics simulations for spherical and spheroidal shapes. For the numerical simulations, we employ the dissipative particle dynamics method for modelling fluid flow. Both the analytical model and simulations show that the propulsion force increases with increasing confinement. However, the swimming velocity under confinement remains lower than the swimmer speed without confinement for all investigated conditions. In simulations, different swimming modes (i.e. pusher, neutral, puller) are investigated, and found to play a significant role in the generation of propulsion force when a swimmer approaches a dead end of a capillary. Propulsion generation in confined systems is local, such that the generated flow field generally vanishes beyond the characteristic size of the swimmer. These results contribute to a better understanding of microswimmer force generation and propulsion under strong confinement, including the motion in porous media and in narrow channels.


title: Selective HuBERT: Self-Supervised Pre-Training for Target Speaker in Clean and Mixture Speech

abstract: Self-supervised pre-trained speech models were shown effective for various downstream speech processing tasks. Since they are mainly pre-trained to map input speech to pseudo-labels, the resulting representations are only effective for the type of pre-train data used, either clean or mixture speech. With the idea of selective auditory attention, we propose a novel pre-training solution called Selective-HuBERT, or SHuBERT, which learns the selective extraction of target speech representations from either clean or mixture speech. Specifically, SHuBERT is trained to predict pseudo labels of a target speaker, conditioned on an enrolled speech from the target speaker. By doing so, SHuBERT is expected to selectively attend to the target speaker in a complex acoustic environment, thus benefiting various downstream tasks. We further introduce a dual-path training strategy and use the cross-correlation constraint between the two branches to encourage the model to generate noise-invariant representation. Experiments on SUPERB benchmark and LibriMix dataset demonstrate the universality and noise-robustness of SHuBERT. Furthermore, we find that our high-quality representation can be easily integrated with conventional supervised learning methods to achieve significant performance, even under extremely low-resource labeled data.


title: Extended Paper: API-driven Program Synthesis for Testing Static Typing Implementations

abstract: We introduce a novel approach for testing static typing implementations based on the concept of API-driven program synthesis. The idea is to synthesize type-intensive but small and well-typed programs by leveraging and combining application programming interfaces (APIs) derived from existing software libraries. Our primary insight is backed up by real-world evidence: a significant number of compiler typing bugs are caused by small test cases that employ APIs from the standard library of the language under test. This is attributed to the inherent complexity of the majority of these APIs, which often exercise a wide range of sophisticated type-related features. The main contribution of our approach is the ability to produce small client programs with increased feature coverage, without bearing the burden of generating the corresponding well-formed API definitions from scratch. To validate diverse aspects of static typing procedures (i.e., soundness, precision of type inference), we also enrich our API-driven approach with fault-injection and semantics-preserving modes, along with their corresponding test oracles. We evaluate our implemented tool, Thalia on testing the static typing implementations of the compilers for three popular languages, namely, Scala, Kotlin, and Groovy. Thalia has uncovered 84 typing bugs (77 confirmed and 22 fixed), most of which are triggered by test cases featuring APIs that rely on parametric polymorphism, overloading, and higher-order functions. Our comparison with state-of-the-art shows that Thalia yields test programs with distinct characteristics, offering additional and complementary benefits.


title: Bandit Learning to Rank with Position-Based Click Models: Personalized and Equal Treatments

abstract: Online learning to rank (ONL2R) is a foundational problem for recommender systems and has received increasing attention in recent years. Among the existing approaches for ONL2R, a natural modeling architecture is the multi-armed bandit framework coupled with the position-based click model. However, developing efficient online learning policies for MAB-based ONL2R with position-based click models is highly challenging due to the combinatorial nature of the problem, and partial observability in the position-based click model. To date, results in MAB-based ONL2R with position-based click models remain rather limited, which motivates us to fill this gap in this work. Our main contributions in this work are threefold: i) We propose the first general MAB framework that captures all key ingredients of ONL2R with position-based click models. Our model considers personalized and equal treatments in ONL2R ranking recommendations, both of which are widely used in practice; ii) Based on the above analytical framework, we develop two unified greed- and UCB-based policies called GreedyRank and UCBRank, each of which can be applied to personalized and equal ranking treatments; and iii) We show that both GreedyRank and UCBRank enjoy $O(\sqrt{t}\ln t)$ and $O(\sqrt{t\ln t})$ anytime sublinear regret for personalized and equal treatment, respectively. For the fundamentally hard equal ranking treatment, we identify classes of collective utility functions and their associated sufficient conditions under which $O(\sqrt{t}\ln t)$ and $O(\sqrt{t\ln t})$ anytime sublinear regrets are still achievable for GreedyRank and UCBRank, respectively. Our numerical experiments also verify our theoretical results and demonstrate the efficiency of GreedyRank and UCBRank in seeking the optimal action under various problem settings.