title: Minimizing Photonic Cluster State Depth in Measurement-Based Quantum Computing

abstract: Measurement-based quantum computing (MBQC) is a promising quantum computing paradigm that performs computation through ``one-way'' measurements on entangled quantum qubits. It is widely used in photonic quantum computing (PQC), where the computation is carried out on photonic cluster states (i.e., a 2-D mesh of entangled photons). In MBQC-based PQC, the cluster state depth (i.e., the length of one-way measurements) to execute a quantum circuit plays an important role in the overall execution time and error. Thus, it is important to reduce the cluster state depth. In this paper, we propose FMCC, a compilation framework that employs dynamic programming to efficiently minimize the cluster state depth. Experimental results on five representative quantum algorithms show that FMCC achieves 53.6%, 60.6%, and 60.0% average depth reductions in small, medium, and large qubit counts compared to the state-of-the-art MBQC compilation frameworks.


title: Less than Equable Triangles on the Eisenstein lattice

abstract: We classify perimeter dominant triangles whose side lengths are in $\sqrt3\mathbb N$ and whose area is in $\frac{\sqrt3}4\mathbb N$. There is one exceptional example, which is equilateral, and three infinite families determined by certain Pell, or Pell-like, equations.


title: Size dependent optical response in coupled systems of plasmons and electron-hole pairs in metallic nanostructures

abstract: In bulk materials, the collective modes and individual modes are orthogonal each other, and no connection occurs if there is no damping processes. In the presence of damping, the collective modes, i.e., plasmons decay into the hot carriers. In finite systems, the collective and individual modes are coupled by the Coulomb interaction. Such couplings by longitudinal (L) field have been intensively investigated, whereas a coupling via transverse (T) field has been poorly studied although the plasmon is excited by an irradiated light on surface and in finite nanostructures. Then, the T field would play a significant role in the coupling between the collective and individual excitations. In this study, we investigate how the T field mediates the coherent coupling. This study is based on the recently developed microscopic nonlocal theory of electronic systems in metals and the results of eigenmode analyses by this theory. To tune the coupling strength in a single nanorod, we examine three parameters: Rod length $L_z$, background refractive index $n_{\rm b}$, and Fermi energy $\varepsilon_{\rm F}$. We discuss the modulation ratio of the spectrum of optical response coefficients to evaluate the coupling by the T field. The T field shifts the collective excitation energy, which causes a finite modulation at both collective excitation and individual excitations. The three parameters can change the energy distance between the collective and individual excitations. Thus, the coherent coupling by the T field is enhanced for a proper tuning of the parameters. The results of the investigation of system parameter dependence would give insight into the guiding principle of designing the materials for highly efficient hot carrier generation.


title: From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscape

abstract: This comprehensive survey explored the evolving landscape of generative Artificial Intelligence (AI), with a specific focus on the transformative impacts of Mixture of Experts (MoE), multimodal learning, and the speculated advancements towards Artificial General Intelligence (AGI). It critically examined the current state and future trajectory of generative Artificial Intelligence (AI), exploring how innovations like Google's Gemini and the anticipated OpenAI Q* project are reshaping research priorities and applications across various domains, including an impact analysis on the generative AI research taxonomy. It assessed the computational challenges, scalability, and real-world implications of these technologies while highlighting their potential in driving significant progress in fields like healthcare, finance, and education. It also addressed the emerging academic challenges posed by the proliferation of both AI-themed and AI-generated preprints, examining their impact on the peer-review process and scholarly communication. The study highlighted the importance of incorporating ethical and human-centric methods in AI development, ensuring alignment with societal norms and welfare, and outlined a strategy for future AI research that focuses on a balanced and conscientious use of MoE, multimodality, and AGI in generative AI.


title: Extreme Variability Quasars in Their Various States. II: Spectral Variation Revealed with Multi-epoch Spectra

abstract: We previously built a sample of 14,012 extremely variable quasars (EVQs) based on SDSS and Pan-STARRS1 photometric observations. In this work we present the spectral fitting to their SDSS spectra, and study the spectral variation in 1,259 EVQs with multi-epoch SDSS spectra (after prudently excluding spectra with potentially unreliable spectroscopic photometry). We find clear "bluer-when-brighter" trend in EVQs, consistent with previous findings of normal quasars and AGNs. We detect significant intrinsic Baldwin effect (iBeff, i.e., smaller line EW at higher continuum flux in individual AGNs) in the broad MgII and CIV lines of EVQs. Meanwhile, no systematical iBeff is found for the broad Hb line, which could be attributed to strong host contamination at longer wavelengths. Remarkably, by comparing the iBeff slope of EVQs with archived changing-look quasars (CLQs), we show that the CLQs identified in literature are mostly likely a biased (due to its definition) sub-population of EVQs, rather than a distinct population of quasars. We also found no significant broad line breathing of either Hb, MgII or CIV, suggesting the broad line breathing in quasars may disappear at longer timescales ($\sim$ 3000 days).


title: Quantiles on global non-positive curvature spaces

abstract: This paper develops a notion of geometric quantiles on Hadamard spaces, also known as global non-positive curvature spaces. After providing some definitions and basic properties, including scaled isometry equivariance and a necessary condition on the gradient of the quantile loss function at quantiles on Hadamard manifolds, we investigate asymptotic properties of sample quantiles on Hadamard manifolds, such as strong consistency and joint asymptotic normality. We provide a detailed description of how to compute quantiles using a gradient descent algorithm in hyperbolic space and, in particular, an explicit formula for the gradient of the quantile loss function, along with experiments using simulated and real single-cell RNA sequencing data.


title: A category equivalence on the Lie algebra of polynomial vector fields

abstract: For any positive integer $n$, let $W_n=\text{Der}(\mathbb{C}[t_1,\dots,t_n])$. The subspaces $\mathfrak{h}_n=\text{Span}\{t_1\frac{\partial}{\partial{t_1}},\dots,t_n\frac{\partial}{\partial{t_n}}\}$ and $\Delta_n=\text{Span}\{\frac{\partial}{\partial{t_1}},\dots,\frac{\partial}{\partial{t_n}}\}$ are two abelian subalgebras of $W_n$. We show that a full subcategory $\Omega_{\mathbf{1}}$ of the category of $W_n$-modules $M$ which are locally finite over $\Delta_n$ is equivalent to some full subcategory of weight $W_n$-modules $M$ which are cuspidal modules when restricted to the subalgebra $\mathfrak{sl}_{n+1}$ of $W_n$.


title: Country-Scale Cropland Mapping in Data-Scarce Settings Using Deep Learning: A Case Study of Nigeria

abstract: Cropland maps are a core and critical component of remote-sensing-based agricultural monitoring, providing dense and up-to-date information about agricultural development. Machine learning is an effective tool for large-scale agricultural mapping, but relies on geo-referenced ground-truth data for model training and testing, which can be scarce or time-consuming to obtain. In this study, we explore the usefulness of combining a global cropland dataset and a hand-labeled dataset to train machine learning models for generating a new cropland map for Nigeria in 2020 at 10 m resolution. We provide the models with pixel-wise time series input data from remote sensing sources such as Sentinel-1 and 2, ERA5 climate data, and DEM data, in addition to binary labels indicating cropland presence. We manually labeled 1827 evenly distributed pixels across Nigeria, splitting them into 50\% training, 25\% validation, and 25\% test sets used to fit the models and test our output map. We evaluate and compare the performance of single- and multi-headed Long Short-Term Memory (LSTM) neural network classifiers, a Random Forest classifier, and three existing 10 m resolution global land cover maps (Google's Dynamic World, ESRI's Land Cover, and ESA's WorldCover) on our proposed test set. Given the regional variations in cropland appearance, we additionally experimented with excluding or sub-setting the global crowd-sourced Geowiki cropland dataset, to empirically assess the trade-off between data quantity and data quality in terms of the similarity to the target data distribution of Nigeria. We find that the existing WorldCover map performs the best with an F1-score of 0.825 and accuracy of 0.870 on the test set, followed by a single-headed LSTM model trained with our hand-labeled training samples and the Geowiki data points in Nigeria, with a F1-score of 0.814 and accuracy of 0.842.


title: Bounded distributive lattices with strict implication and weak difference

abstract: In this paper we introduce the class of weak Heyting Brouwer algebras (WHB-algebras, for short). We extend the well known duality between distributive lattices and Priestley spaces, in order to exhibit a relational Priestley-like duality for WHB-algebras. Finally, as an application of the duality, we build the tense extension of a WHB-algebra and we employ it as a tool for proving structural properties of the variety such as the finite model property, the amalgamation property, the congruence extension property and the Maehara interpolation property.


title: Electronic and optical properties of ternary kagome Rb$_{2}$Ni$_{3}$S$_4$

abstract: The application of semiconductors with optical properties has grown significantly in the development of semiconductor photovoltaics. In this study, the electronic and optical properties of ternary transition metal sulfide Rb$_{2}$Ni$_{3}$S$_4$ is studied by means of density functional theory calculation within the framework of generalized gradient approximation. From the structural perspective, Ni atoms is found to form a kagome-like lattice in a two-dimensional plane of Rb$_{2}$Ni$_{3}$S$_4$. From the electronic structure calculations, the material is found to be a semiconductor with an indirect band gap of $\sim$0.67 eV. The orbital contributions to the density of states and band structure around the Fermi level are from the Ni-$3d$ and S-$3p$ states. Significant hybridization was observed between the S-$3p_x$ and S-$3p_y$ with the Ni-3$d_{xz}$ and Ni-3$d_{yz}$ orbitals. Interestingly, flat band was noticed below the Fermi level demonstrating one significant feature of kagome lattice. From the optical calculations, Rb$_{2}$Ni$_{3}$S$_4$ is found to exhibit optical activity in both the visible and ultraviolet regions of the incident photon energies. This optical response suggests that the material as a potential candidate for opto-electronic device application, given its ability to interact with light across a broad range of wavelengths. This work is expected to motivate experimental group for transport measurements and may provide a new foundation for the development of opto-electronic applications.


title: Limit Law for the Maximum Interpoint Distance of High Dimensional Dependent Variables

abstract: In this paper, we considier the limiting distribution of the maximum interpoint Euclidean distance $M_n=\max _{1 \leq i<j \leq n}\left\|\boldsymbol{X}_i-\boldsymbol{X}_j\right\|$, where $\boldsymbol{X}_1, \boldsymbol{X}_2, \ldots, \boldsymbol{X}_n$ be a random sample coming from a $p$-dimensional population with dependent sub-gaussian components. When the dimension tends to infinity with the sample size, we proves that $M_n^2$ under a suitable normalization asymptotically obeys a Gumbel type distribution. The proofs mainly depend on the Stein-Chen Poisson approximation method and high dimensional Gaussian approximation.


title: An alternative definition of tense operators on residuated lattices

abstract: In this paper we introduce and study an alternative definition of tense operators on residuated lattices. We give a categorical equivalence for the class of tense residuated lattices, which is motivated by an old construction due to J. Kalman. The paper concludes with some applications regarding the description of congruences and a 2-contextual translation.


title: Mimic: Speaking Style Disentanglement for Speech-Driven 3D Facial Animation

abstract: Speech-driven 3D facial animation aims to synthesize vivid facial animations that accurately synchronize with speech and match the unique speaking style. However, existing works primarily focus on achieving precise lip synchronization while neglecting to model the subject-specific speaking style, often resulting in unrealistic facial animations. To the best of our knowledge, this work makes the first attempt to explore the coupled information between the speaking style and the semantic content in facial motions. Specifically, we introduce an innovative speaking style disentanglement method, which enables arbitrary-subject speaking style encoding and leads to a more realistic synthesis of speech-driven facial animations. Subsequently, we propose a novel framework called \textbf{Mimic} to learn disentangled representations of the speaking style and content from facial motions by building two latent spaces for style and content, respectively. Moreover, to facilitate disentangled representation learning, we introduce four well-designed constraints: an auxiliary style classifier, an auxiliary inverse classifier, a content contrastive loss, and a pair of latent cycle losses, which can effectively contribute to the construction of the identity-related style space and semantic-related content space. Extensive qualitative and quantitative experiments conducted on three publicly available datasets demonstrate that our approach outperforms state-of-the-art methods and is capable of capturing diverse speaking styles for speech-driven 3D facial animation. The source code and supplementary video are publicly available at: https://zeqing-wang.github.io/Mimic/


title: Time-periodic solutions to the Navier--Stokes equations on the whole space including the two-dimensional case

abstract: Let us consider the incompressible Navier--Stokes equations with the time-periodic external forces in the whole space $\mathbb{R}^n$ with $n\geq 2$ and investigate the existence and non-existence of time-periodic solutions. In the higher dimensional case $n \geq 3$, we construct a unique small solution for given small time-periodic force in the scaling critical spaces of Besov type and prove its stability under small perturbations. In contrast, for the two-dimensional case $n=2$, the time-periodic solvability of the Navier--Stokes equations has been long standing open. It is the central work of this paper that we have now succeeded in solving this issue negatively by providing examples of small external forces such that each of them does not generate time-periodic solutions.


title: Development and Evaluation of Ensemble Learning-based Environmental Methane Detection and Intensity Prediction Models

abstract: The environmental impacts of global warming driven by methane (CH4) emissions have catalyzed significant research initiatives in developing novel technologies that enable proactive and rapid detection of CH4. Several data-driven machine learning (ML) models were tested to determine how well they identified fugitive CH4 and its related intensity in the affected areas. Various meteorological characteristics, including wind speed, temperature, pressure, relative humidity, water vapor, and heat flux, were included in the simulation. We used the ensemble learning method to determine the best-performing weighted ensemble ML models built upon several weaker lower-layer ML models to (i) detect the presence of CH4 as a classification problem and (ii) predict the intensity of CH4 as a regression problem.


title: Sharable Clothoid-based Continuous Motion Planning for Connected Automated Vehicles

abstract: A continuous motion planning method for connected automated vehicles is considered for generating feasible trajectories in real-time using three consecutive clothoids. The proposed method reduces path planning to a small set of nonlinear algebraic equations such that the generated path can be efficiently checked for feasibility and collision. After path planning, velocity planning is executed while maintaining a parallel simple structure. Key strengths of this framework include its interpretability, shareability, and ability to specify boundary conditions. Its interpretability and shareability stem from the succinct representation of the resulting local motion plan using a handful of physically meaningful parameters. Vehicles may share these parameters via V2X communication so that the recipients can precisely reconstruct the planned trajectory of the senders and respond accordingly. The proposed local planner guarantees the satisfaction of boundary conditions, thus ensuring seamless integration with a wide array of higher-level global motion planners. The tunable nature of the method enables tailoring the local plans to specific maneuvers like turns at intersections, lane changes, and U-turns.


title: Dirac walks on regular trees

abstract: The study of matter fields on an ensemble of random geometries is a difficult problem still in need of new methods and ideas. We will follow a point of view inspired by probability theory techniques that relies on an expansion of the two point function as a sum over random walks. An analogous expansion for Fermions on non-Euclidean geometries is still lacking. Casiday et al. [\textit{Laplace and Dirac operators on graphs}, Linear and Multilinear Algebra (2022) 1] proposed a classical "Dirac walk" diffusing on vertices and edges of an oriented graph with a square root of the graph Laplacian. In contrast to the simple random walk, each step of the walk is given a sign depending on the orientation of the edge it goes through. In a toy model, we propose here to study the Green functions, spectrum and the spectral dimension of such "Dirac walks" on the Bethe lattice, a $d$-regular tree. The recursive structure of the graph makes the problem exactly solvable. Notably, we find that the spectrum develops a gap and that the spectral dimension of the Dirac walk matches that of the simple random walk ($d_s=1$ for $d=2$ and $d_s=3$ for $d\geq 3$).

categories: cond-mat.stat-mech hep-th math-ph math.MP


title: Stationary Navier--Stokes equations on the half spaces in the scaling critical framework

abstract: In this paper, we consider the inhomogeneous Dirichlet boundary value problem for the stationary Navier--Stokes equations in $n$-dimensional half spaces $\mathbb{R}^n_+= \{ x=(x',x_n)\ ;\ x' \in \mathbb{R}^{n-1}, x_n > 0 \}$ with $n \geq 3$ and prove the well-posedness in the scaling critical Besov spaces. Our approach is to regard the system as an evolution equation for the normal variable $x_n$ and reformulate it as an integral equation. Then, we achieve the goal by making use of the maximal regularity method that has developed in the context of nonstationary analysis in critical Besov spaces. Furthermore, for the case of $n \geq 4$, we find that the asymptotic profile of the solution as $x_n \to \infty$ is given by the $(n-1)$-dimensional stationary Navier--Stokes flow.


title: Backward stochastic difference equations on lattices with application to market equilibrium analysis

abstract: We study backward stochastic difference equations (BS{\Delta}E) driven by a d-dimensional stochastic process on a lattice whose increments have only d + 1 possible values that generates the lattice. Regarding the driving process as a d dimensional asset price process, we give applications to an optimal investment problem and a market equilibrium analysis, where utility functionals are defined through BS{\Delta}E.


title: Contextual Reinforcement Learning for Offshore Wind Farm Bidding

abstract: We propose a framework for applying reinforcement learning to contextual two-stage stochastic optimization and apply this framework to the problem of energy market bidding of an off-shore wind farm. Reinforcement learning could potentially be used to learn close to optimal solutions for first stage variables of a two-stage stochastic program under different contexts. Under the proposed framework, these solutions would be learned without having to solve the full two-stage stochastic program. We present initial results of training using the DDPG algorithm and present intended future steps to improve performance.


title: A novel diffusion recommendation algorithm based on multi-scale cnn and residual lstm

abstract: Sequential recommendation aims to infer user preferences from historical interaction sequences and predict the next item that users may be interested in the future. The current mainstream design approach is to represent items as fixed vectors, capturing the underlying relationships between items and user preferences based on the order of interactions. However, relying on a single fixed-item embedding may weaken the modeling capability of the system, and the global dynamics and local saliency exhibited by user preferences need to be distinguished. To address these issues, this paper proposes a novel diffusion recommendation algorithm based on multi-scale cnn and residual lstm (AREAL). We introduce diffusion models into the recommend system, representing items as probability distributions instead of fixed vectors. This approach enables adaptive reflection of multiple aspects of the items and generates item distributions in a denoising manner. We use multi-scale cnn and residual lstm methods to extract the local and global dependency features of user history interactions, and use attention mechanism to distinguish weights as the guide features of reverse diffusion recovery. The effectiveness of the proposed method is validated through experiments conducted on two real-world datasets. Specifically, AREAL obtains improvements over the best baselines by 2.63% and 4.25% in terms of HR@20 and 5.05% and 3.94% in terms of NDCG@20 on all datasets.


title: Unconventional $s$-Wave Pairing with Point-Node-Like Gap Structure in UTe$_2$

abstract: We explore the pairing state and gap structure of UTe$_2$ using a six-orbital model which we call the $f$-$d$-$p$ model. Our model accurately reproduces the quasi-two-dimensional Fermi surfaces consistent with recent de Haas-van Alphen oscillation measurements and the $(0, \pm \pi, 0)$ antiferromagnetic spin fluctuations observed by neutron scattering. We incorporate on-site Coulomb repulsion for $f$ electrons and solve the linearized Eliashberg equation within the third-order perturbation theory to investigate the superconducting symmetry in UTe$_2$. The most likely state is found to be an $s$-wave state with a highly anisotropic superconducting gap structure that exhibits a point-node-like behavior of the specific heat at low temperatures.


title: On Computing Makespan-Optimal Solutions for Generalized Sliding-Tile Puzzles

abstract: In the $15$-puzzle game, $15$ labeled square tiles are reconfigured on a $4\times 4$ board through an escort, wherein each (time) step, a single tile neighboring it may slide into it, leaving the space previously occupied by the tile as the new escort. We study a generalized sliding-tile puzzle (GSTP) in which (1) there are $1+$ escorts and (2) multiple tiles can move synchronously in a single time step. Compared with popular discrete multi-agent/robot motion models, GSTP provides a more accurate model for a broad array of high-utility applications, including warehouse automation and autonomous garage parking, but is less studied due to the more involved tile interactions. In this work, we analyze optimal GSTP solution structures, establishing that computing makespan-optimal solutions for GSTP is NP-complete and developing polynomial time algorithms yielding makespans approximating the minimum with expected/high probability constant factors, assuming randomized start and goal configurations.


title: Age-Threshold Slotted ALOHA for Optimizing Information Freshness in Mobile Networks

abstract: We optimize the Age of Information (AoI) in mobile networks using the age-threshold slotted ALOHA (TSA) protocol. The network comprises multiple source-destination pairs, where each source sends a sequence of status update packets to its destination over a shared spectrum. The TSA protocol stipulates that a source node must remain silent until its AoI reaches a predefined threshold, after which the node accesses the radio channel with a certain probability. Using stochastic geometry tools, we derive analytical expressions for the transmission success probability, mean peak AoI, and time-average AoI. Subsequently, we obtain closed-form expressions for the optimal update rate and age threshold that minimize the mean peak and time-average AoI, respectively. In addition, we establish a scaling law for the mean peak AoI and time-average AoI in mobile networks, revealing that the optimal mean peak AoI and time-average AoI increase linearly with the deployment density. Notably, the growth rate of time-average AoI under TSA is half of that under conventional slotted ALOHA. When considering the optimal mean peak AoI, the TSA protocol exhibits comparable performance to the traditional slotted ALOHA protocol. These findings conclusively affirm the advantage of TSA in reducing higher-order AoI, particularly in densely deployed networks.


title: Generating functions for the quotients of numerical semigroups

abstract: We propose a class of generating functions denoted by $\textrm{RGF}_p(x)$, which is related to the Sylvester denumerant for the quotients of numerical semigroups. Using MacMahon's partition analysis, we can obtain $\textrm{RGF}_p(x)$ by extracting the constant term of a rational function. We use $\textrm{RGF}_p(x)$ to give a system of generators of the quotient of the numerical semigroup $\langle a_1,a_2,a_3\rangle$ by $p$ for a small positive integer $p$ and we characterise the generators for $\frac{\langle A\rangle}{p}$ for a general numerical semigroup $A$ and any positive integer $p$.


title: Low-latency Space-time Supersampling for Real-time Rendering

abstract: With the rise of real-time rendering and the evolution of display devices, there is a growing demand for post-processing methods that offer high-resolution content in a high frame rate. Existing techniques often suffer from quality and latency issues due to the disjointed treatment of frame supersampling and extrapolation. In this paper, we recognize the shared context and mechanisms between frame supersampling and extrapolation, and present a novel framework, Space-time Supersampling (STSS). By integrating them into a unified framework, STSS can improve the overall quality with lower latency. To implement an efficient architecture, we treat the aliasing and warping holes unified as reshading regions and put forth two key components to compensate the regions, namely Random Reshading Masking (RRM) and Efficient Reshading Module (ERM). Extensive experiments demonstrate that our approach achieves superior visual fidelity compared to state-of-the-art (SOTA) methods. Notably, the performance is achieved within only 4ms, saving up to 75\% of time against the conventional two-stage pipeline that necessitates 17ms.


title: A generalization of the relaxation-based matrix splitting iterative method for solving the system of generalized absolute value equations

abstract: By incorporating a new matrix splitting and the momentum acceleration into the relaxed-based matrix splitting (RMS) method \cite{soso2023}, a generalization of the RMS (GRMS) iterative method for solving the generalized absolute value equations (GAVEs) is proposed. Unlike some existing methods, by using the Cauchy's convergence principle, we give some sufficient conditions for the existence and uniqueness of the solution to the GAVEs and prove that our method can converge to the unique solution of the GAVEs. Moreover, we can obtain a few new and weaker convergence conditions for some existing methods. Preliminary numerical experiments show that the proposed method is efficient.


title: Deep Learning-based MRI Reconstruction with Artificial Fourier Transform (AFT)-Net

abstract: The deep complex-valued neural network provides a powerful way to leverage complex number operations and representations, which has succeeded in several phase-based applications. However, most previously published networks have not fully accessed the impact of complex-valued networks in the frequency domain. Here, we introduced a unified complex-valued deep learning framework - artificial Fourier transform network (AFT-Net) - which combined domain-manifold learning and complex-valued neural networks. The AFT-Net can be readily used to solve the image inverse problems in domain-transform, especially for accelerated magnetic resonance imaging (MRI) reconstruction and other applications. While conventional methods only accept magnitude images, the proposed method takes raw k-space data in the frequency domain as inputs, allowing a mapping between the k-space domain and the image domain to be determined through cross-domain learning. We show that AFT-Net achieves superior accelerated MRI reconstruction and is comparable to existing approaches. Also, our approach can be applied to different tasks like denoised MRS reconstruction and different datasets with various contrasts. The AFT-Net presented here is a valuable preprocessing component for different preclinical studies and provides an innovative alternative for solving inverse problems in imaging and spectroscopy.


title: The Metacognitive Demands and Opportunities of Generative AI

abstract: Generative AI (GenAI) systems offer unprecedented opportunities for transforming professional and personal work, yet present challenges around prompting, evaluating and relying on outputs, and optimizing workflows. We argue that metacognition$\unicode{x2013}$the psychological ability to monitor and control one's thoughts and behavior$\unicode{x2013}$offers a valuable lens to understand and design for these usability challenges. Drawing on research in psychology and cognitive science, and recent GenAI user studies, we illustrate how GenAI systems impose metacognitive demands on users, requiring a high degree of metacognitive monitoring and control. We propose these demands could be addressed by integrating metacognitive support strategies into GenAI systems, and by designing GenAI systems to reduce their metacognitive demand by targeting explainability and customizability. Metacognition offers a coherent framework for understanding the usability challenges posed by GenAI, and provides novel research and design directions to advance human-AI interaction.


title: Effectiveness of Constant Stepsize in Markovian LSA and Statistical Inference

abstract: In this paper, we study the effectiveness of using a constant stepsize in statistical inference via linear stochastic approximation (LSA) algorithms with Markovian data. After establishing a Central Limit Theorem (CLT), we outline an inference procedure that uses averaged LSA iterates to construct confidence intervals (CIs). Our procedure leverages the fast mixing property of constant-stepsize LSA for better covariance estimation and employs Richardson-Romberg (RR) extrapolation to reduce the bias induced by constant stepsize and Markovian data. We develop theoretical results for guiding stepsize selection in RR extrapolation, and identify several important settings where the bias provably vanishes even without extrapolation. We conduct extensive numerical experiments and compare against classical inference approaches. Our results show that using a constant stepsize enjoys easy hyperparameter tuning, fast convergence, and consistently better CI coverage, especially when data is limited.


title: More on greedy construction heuristics for the MAX-CUT problem

abstract: A cut of a graph can be represented in many different ways. Here we propose to represent a cut through a ``relation tree'', which is a spanning tree with signed edges. We show that this picture helps to classify the main greedy heuristics for the maximum cut problem, in analogy with the minimum spanning tree problem. Namely, all versions of the Sahni-Gonzalez~(SG) algorithms could be classified as the Prim class, while various Edge-Contraction~(EC) algorithms are of the Kruskal class. We further elucidate the relation of this framework to the stabilizer formalism in quantum computing, and point out that the recently proposed \textit{ADAPT-Clifford} algorithm is a reformulation of a refined version of the SG algorithm, SG3. Numerical performance of the typical algorithms from the two classes are studied with various kinds of graphs. It turns out that, the Prim-class algorithms perform better for general dense graphs, and the Kruskal-class algorithms performs better when the graphs are sparse enough.


title: The Market for Lemons and the Regulator's Signalling Problem

abstract: The Market for Lemons is a classic model of asymmetric information first studied by Nobel Prize economist George Akerlof. It shows that information asymmetry between the seller and buyer may result in market collapse or some sellers leaving the market. "Lemons" in the used car market are cars of poor quality. The information asymmetry present is that the buyer is uncertain of the cars' true quality. I first offer a simple baseline model that illustrates the market collapse, and then examine what happens when regulation, ie. a DMV is introduced to reveal (signal) the true car quality to the buyer. The effect on the market varies based on the assumptions about the regulator. The central focus is on the DMV's signal structure, which can have interesting effects on the market and the information asymmetry. I show that surprisingly, when the DMV actually decreases the quality of their signal in a well constructed way, it can substantially increase their profit. On the other hand, this negatively effects overall welfare.


title: Generalized Category Discovery with Large Language Models in the Loop

abstract: Generalized Category Discovery (GCD) is a crucial task that aims to recognize both known and novel categories from a set of unlabeled data by utilizing a few labeled data with only known categories. Due to the lack of supervision and category information, current methods usually perform poorly on novel categories and struggle to reveal semantic meanings of the discovered clusters, which limits their applications in the real world. To mitigate the above issues, we propose Loop, an end-to-end active-learning framework that introduces Large Language Models (LLMs) into the training loop, which can boost model performance and generate category names without relying on any human efforts. Specifically, we first propose Local Inconsistent Sampling (LIS) to select samples that have a higher probability of falling to wrong clusters, based on neighborhood prediction consistency and entropy of cluster assignment probabilities. Then we propose a Scalable Query strategy to allow LLMs to choose true neighbors of the selected samples from multiple candidate samples. Based on the feedback from LLMs, we perform Refined Neighborhood Contrastive Learning (RNCL) to pull samples and their neighbors closer to learn clustering-friendly representations. Finally, we select representative samples from clusters corresponding to novel categories to allow LLMs to generate category names for them. Extensive experiments on three benchmark datasets show that Loop outperforms SOTA models by a large margin and generates accurate category names for the discovered clusters. Code and data are available at https://github.com/Lackel/LOOP.


title: Replica symmetry breaking in 1D Rayleigh scattering system: theory and validations

abstract: Spin glass theory, as a paradigm for describing disordered magnetic systems, constitutes a prominent subject of study within statistical physics. Replica symmetry breaking (RSB), as one of the pivotal concepts for the understanding of spin glass theory, means that, under identical conditions disordered systems can yield distinct states with nontrivial correlations. Random fiber laser (RFL) based on Rayleigh scattering (RS) is a complex disordered system, owing to the disorder and stochasticity of RS. In this work, for the first time, we elaborate a precise theoretical model for studying the photonic phase transition via the platform of RS-based RFL, in which we clearly reveal that, apart from the pump power, the photon phase variation in RFL is also an analogy to the temperature term in spin glass phase transition, leading to a novel insight into the intrinsic mechanisms of photonic phase transition. In addition, based on this model and real-time high-fidelity detection spectral evolution, we theoretically predict and experimentally observe the mode-asymmetric characteristics of photonic phase transition in RS-based RFL. This finding contributes to a deeper understanding of the photonic RSB regime and the dynamics of RS-based RFL.


title: MagicScroll: Nontypical Aspect-Ratio Image Generation for Visual Storytelling via Multi-Layered Semantic-Aware Denoising

abstract: Visual storytelling often uses nontypical aspect-ratio images like scroll paintings, comic strips, and panoramas to create an expressive and compelling narrative. While generative AI has achieved great success and shown the potential to reshape the creative industry, it remains a challenge to generate coherent and engaging content with arbitrary size and controllable style, concept, and layout, all of which are essential for visual storytelling. To overcome the shortcomings of previous methods including repetitive content, style inconsistency, and lack of controllability, we propose MagicScroll, a multi-layered, progressive diffusion-based image generation framework with a novel semantic-aware denoising process. The model enables fine-grained control over the generated image on object, scene, and background levels with text, image, and layout conditions. We also establish the first benchmark for nontypical aspect-ratio image generation for visual storytelling including mediums like paintings, comics, and cinematic panoramas, with customized metrics for systematic evaluation. Through comparative and ablation studies, MagicScroll showcases promising results in aligning with the narrative text, improving visual coherence, and engaging the audience. We plan to release the code and benchmark in the hope of a better collaboration between AI researchers and creative practitioners involving visual storytelling.


title: RetroOOD: Understanding Out-of-Distribution Generalization in Retrosynthesis Prediction

abstract: Machine learning-assisted retrosynthesis prediction models have been gaining widespread adoption, though their performances oftentimes degrade significantly when deployed in real-world applications embracing out-of-distribution (OOD) molecules or reactions. Despite steady progress on standard benchmarks, our understanding of existing retrosynthesis prediction models under the premise of distribution shifts remains stagnant. To this end, we first formally sort out two types of distribution shifts in retrosynthesis prediction and construct two groups of benchmark datasets. Next, through comprehensive experiments, we systematically compare state-of-the-art retrosynthesis prediction models on the two groups of benchmarks, revealing the limitations of previous in-distribution evaluation and re-examining the advantages of each model. More remarkably, we are motivated by the above empirical insights to propose two model-agnostic techniques that can improve the OOD generalization of arbitrary off-the-shelf retrosynthesis prediction algorithms. Our preliminary experiments show their high potential with an average performance improvement of 4.6%, and the established benchmarks serve as a foothold for further retrosynthesis prediction research towards OOD generalization.


title: Quantum criticality in quasi-binary compounds of iron-based superconductors

abstract: In this work, we present the studies of structural phase transitions in Fe(Se,Te) crystals in the range of about 30% selenium substitution by tellurium. We found a significant change in the properties of the ordered state of these compositions compared to the case of pure FeSe. The resistivity at low temperatures for the studied Fe(Se,Te) is proportional to the square of the temperature while for pure FeSe below the structural transition it depends almost linearly on temperature. The NMR data show a noticeable line broadening below the structural transition and an anomaly in the temperature dependence of the relaxation rate in the tellurium-substituted compounds, which was not observed in the pure FeSe. This reveals in quasi-binary compounds of iron-based superconductors a region of quantum criticality similar to that which exists when the nematicity of FeSe is suppressed under pressure and which precedes the emergence of high-temperature superconductivity in FeSe under hydrostatic pressure.


title: Autonomous stabilization with programmable stabilized state

abstract: Reservoir engineering is a powerful technique to autonomously stabilize a quantum state. Traditional schemes involving multi-body states typically function for discrete entangled states. In this work, we enhance the stabilization capability to a continuous manifold of states with programmable stabilized state selection using multiple continuous tuning parameters. We experimentally achieve $84.6\%$ and $82.5\%$ stabilization fidelity for the odd and even-parity Bell states as two special points in the manifold. We also perform fast dissipative switching between these opposite parity states within $1.8\mu s$ and $0.9\mu s$ by sequentially applying different stabilization drives. Our result is a precursor for new reservoir engineering-based error correction schemes.


title: Robust Node Representation Learning via Graph Variational Diffusion Networks

abstract: Node representation learning by using Graph Neural Networks (GNNs) has been widely explored. However, in recent years, compelling evidence has revealed that GNN-based node representation learning can be substantially deteriorated by delicately-crafted perturbations in a graph structure. To learn robust node representation in the presence of perturbations, various works have been proposed to safeguard GNNs. Within these existing works, Bayesian label transition has been proven to be more effective, but this method is extensively reliant on a well-built prior distribution. The variational inference could address this limitation by sampling the latent node embedding from a Gaussian prior distribution. Besides, leveraging the Gaussian distribution (noise) in hidden layers is an appealing strategy to strengthen the robustness of GNNs. However, our experiments indicate that such a strategy can cause over-smoothing issues during node aggregation. In this work, we propose the Graph Variational Diffusion Network (GVDN), a new node encoder that effectively manipulates Gaussian noise to safeguard robustness on perturbed graphs while alleviating over-smoothing issues through two mechanisms: Gaussian diffusion and node embedding propagation. Thanks to these two mechanisms, our model can generate robust node embeddings for recovery. Specifically, we design a retraining mechanism using the generated node embedding to recover the performance of node classifications in the presence of perturbations. The experiments verify the effectiveness of our proposed model across six public datasets.


title: Dynamic Retrieval Augmented Generation of Ontologies using Artificial Intelligence (DRAGON-AI)

abstract: Background: Ontologies are fundamental components of informatics infrastructure in domains such as biomedical, environmental, and food sciences, representing consensus knowledge in an accurate and computable form. However, their construction and maintenance demand substantial resources and necessitate substantial collaboration between domain experts, curators, and ontology experts. We present Dynamic Retrieval Augmented Generation of Ontologies using AI (DRAGON-AI), an ontology generation method employing Large Language Models (LLMs) and Retrieval Augmented Generation (RAG). DRAGON-AI can generate textual and logical ontology components, drawing from existing knowledge in multiple ontologies and unstructured text sources. Results: We assessed performance of DRAGON-AI on de novo term construction across ten diverse ontologies, making use of extensive manual evaluation of results. Our method has high precision for relationship generation, but has slightly lower precision than from logic-based reasoning. Our method is also able to generate definitions deemed acceptable by expert evaluators, but these scored worse than human-authored definitions. Notably, evaluators with the highest level of confidence in a domain were better able to discern flaws in AI-generated definitions. We also demonstrated the ability of DRAGON-AI to incorporate natural language instructions in the form of GitHub issues. Conclusions: These findings suggest DRAGON-AI's potential to substantially aid the manual ontology construction process. However, our results also underscore the importance of having expert curators and ontology editors drive the ontology generation process.


title: Satellite Captioning: Large Language Models to Augment Labeling

abstract: With the growing capabilities of modern object detection networks and datasets to train them, it has gotten more straightforward and, importantly, less laborious to get up and running with a model that is quite adept at detecting any number of various objects. However, while image datasets for object detection have grown and continue to proliferate (the current most extensive public set, ImageNet, contains over 14m images with over 14m instances), the same cannot be said for textual caption datasets. While they have certainly been growing in recent years, caption datasets present a much more difficult challenge due to language differences, grammar, and the time it takes for humans to generate them. Current datasets have certainly provided many instances to work with, but it becomes problematic when a captioner may have a more limited vocabulary, one may not be adequately fluent in the language, or there are simple grammatical mistakes. These difficulties are increased when the images get more specific, such as remote sensing images. This paper aims to address this issue of potential information and communication shortcomings in caption datasets. To provide a more precise analysis, we specify our domain of images to be remote sensing images in the RSICD dataset and experiment with the captions provided here. Our findings indicate that ChatGPT grammar correction is a simple and effective way to increase the performance accuracy of caption models by making data captions more diverse and grammatically correct.


title: An Application of Optimal Control Theory to R-Tipping

abstract: An application of optimal control theory results in a lower bound on the speed $|\dot{\lambda}(t)|$ that must be attained at least once by any external forcing function that induces tipping in the asymptotically autonomous scalar ODE $\dot{x} = f(x+\lambda(t))$. The value of this critical speed depends on the total arclength $\int_{-\infty}^{\infty} |\dot{\lambda}(t)| dt$ of forcing, and may be interpreted as a safe threshold rate associated to each given arclength, such that if the speed of forcing remains everywhere slower than this, tipping cannot occur. The bound is tight in the sense that there exists a forcing function (continuous but non-smooth) which induces tipping, possesses the required arclength, and never exceeds the threshold speed. Further, the threshold speed is a strictly decreasing function of arclength, thus capturing the abstract trade off between how fast and how far of a minimal disturbance characterizes tipping.


title: Global existence and low mach number limit of strong solutions to the full compressible Navier-Stokes equations around the plane Couette flow

abstract: In this paper, we study the global existence and low Mach number limit of strong solutions to the 2-D full compressible Navier-Stokes equations around the plane Couette flow in a horizontally periodic layer with non-slip and isothermal boundary conditions. It is shown that the plane Couette flow is asymptotically stable for sufficiently small initial perturbations, provided that the Reynolds number, Mach number and temperature difference between the top and the lower walls are small. For the case that both the top and the lower walls maintain the same temperature, we further prove that such global strong solutions converge to a steady solution of the incompressible Navier-Stokes equations as the Mach number goes to zero.


title: CLOVA: A Closed-Loop Visual Assistant with Tool Usage and Update

abstract: Utilizing large language models (LLMs) to compose off-the-shelf visual tools represents a promising avenue of research for developing robust visual assistants capable of addressing diverse visual tasks. However, these methods often overlook the potential for continual learning, typically by freezing the utilized tools, thus limiting their adaptation to environments requiring new knowledge. To tackle this challenge, we propose CLOVA, a Closed-Loop Visual Assistant, which operates within a framework encompassing inference, reflection, and learning phases. During the inference phase, LLMs generate programs and execute corresponding tools to complete assigned tasks. In the reflection phase, a multimodal global-local reflection scheme analyzes human feedback to determine which tools require updating. Lastly, the learning phase employs three flexible approaches to automatically gather training data and introduces a novel prompt tuning scheme to update the tools, allowing CLOVA to efficiently acquire new knowledge. Experimental findings demonstrate that CLOVA surpasses existing tool-usage methods by 5% in visual question answering and multiple-image reasoning, by 10% in knowledge tagging, and by 20% in image editing. These results underscore the significance of the continual learning capability in general visual assistants.


title: Laguerre inequalities and determinantal inequalities for the finite difference of the partition functions

abstract: The paper aims to establish the Tur\'an inequalities, the Laguerre inequalities (order $2$), and the determinantal inequalities (order $3$) for $\Delta p(n)$ and $\Delta \bar{p}(n)$, where $\Delta f(n)$ is the first-order forward difference of a sequence $f(n)$. The functions $p(n)$ and $\bar{p}(n)$ denote the partition function and overpartition function, respectively. Conjectures for thresholds of Laguerre inequalities (order $m$) and positivity of $m$-order determinants are proposed, extending to $\Delta^k p(n)$ and $\Delta^k \bar{p}(n)$, with $1 \leq m \leq 11$ and $1 \leq k \leq 5$.


title: Bounds for Greedy $B_h$-sets

abstract: A set $A$ of nonnegative integers is called a $B_h$-set if every solution to $a_1+\dots+a_h = b_1+\dots+b_h$, where $a_i,b_i \in A$, has $\{a_1,\dots,a_h\}=\{b_1,\dots,b_h\}$ (as multisets). Let $\gamma_k(h)$ be the $k$-th positive element of the greedy $B_h$-set. We give a nontrivial lower bound on $\gamma_5(h)$, and a nontrivial upper bound on $\gamma_k(h)$ for $k\ge 5$. Specifically, $\frac 18 h^4 +\frac12 h^3 \le \gamma_5(h) \le 0.467214 h^4+O(h^3)$, although we conjecture that $\gamma_5(h)=\frac13 h^4 +O(h^3)$. We show that $\gamma_k(h) \ge \frac{1}{k!} h^{k-1} + O(h^{k-2})$ for $k\ge 1$ and $\gamma_k(h) \le \alpha_k h^{k-1}+O(h^{k-2})$, where $\alpha_6 := 0.382978$, $\alpha_7 := 0.269877$, and for $k\ge 7$, $\alpha_{k+1} := \frac{1}{2^k k!} \sum_{j=0}^{k-1} \binom{k-1}j\binom kj 2^j$. This work begins with a thorough introduction and concludes with a section of open problems.


title: The Pros and Cons of Adversarial Robustness

abstract: Robustness is widely regarded as a fundamental problem in the analysis of machine learning (ML) models. Most often robustness equates with deciding the non-existence of adversarial examples, where adversarial examples denote situations where small changes on some inputs cause a change in the prediction. The perceived importance of ML model robustness explains the continued progress observed for most of the last decade. Whereas robustness is often assessed locally, i.e. given some target point in feature space, robustness can also be defined globally, i.e. where any point in feature space can be considered. The importance of ML model robustness is illustrated for example by the existence of competitions evaluating the progress of robustness tools, namely in the case of neural networks (NNs) but also by efforts towards robustness certification. More recently, robustness tools have also been used for computing rigorous explanations of ML models. In contrast with the observed successes of robustness, this paper uncovers some limitations with existing definitions of robustness, both global and local, but also with efforts towards robustness certification. The paper also investigates uses of adversarial examples besides those related with robustness.


title: Discovery of an Unconventional Quantum Echo by Interference of Higgs Coherence

abstract: Nonlinearities in quantum systems are fundamentally characterized by the interplay of phase coherences, their interference, and state transition amplitudes. Yet the question of how quantum coherence and interference manifest in transient, massive Higgs excitations, prevalent within both the quantum vacuum and superconductors, remains elusive. One hallmark example is photon echo, enabled by the generation, preservation, and retrieval of phase coherences amid multiple excitations. Here we reveal an unconventional quantum echo arising from the Higgs coherence in superconductors, and identify distinctive signatures attributed to Higgs anharmonicity. A terahertz pulse-pair modulation of the superconducting gap generates a "time grating" of coherent Higgs population, which scatters echo signals distinct from conventional spin- and photon-echoes in atoms and semiconductors. These manifestations appear as Higgs echo spectral peaks occurring at frequencies forbidden by equilibrium particle-hole symmetry, an asymmetric delay in the echo formation from the dynamics of the "reactive" superconducting state, and negative time signals arising from Higgs-quasiparticle anharmonic coupling. The Higgs interference and anharmonicity control the decoherence of driven superconductivity and may enable applications in quantum memory and entanglement.


title: GINN-LP: A Growing Interpretable Neural Network for Discovering Multivariate Laurent Polynomial Equations

abstract: Traditional machine learning is generally treated as a black-box optimization problem and does not typically produce interpretable functions that connect inputs and outputs. However, the ability to discover such interpretable functions is desirable. In this work, we propose GINN-LP, an interpretable neural network to discover the form and coefficients of the underlying equation of a dataset, when the equation is assumed to take the form of a multivariate Laurent Polynomial. This is facilitated by a new type of interpretable neural network block, named the "power-term approximator block", consisting of logarithmic and exponential activation functions. GINN-LP is end-to-end differentiable, making it possible to use backpropagation for training. We propose a neural network growth strategy that will enable finding the suitable number of terms in the Laurent polynomial that represents the data, along with sparsity regularization to promote the discovery of concise equations. To the best of our knowledge, this is the first model that can discover arbitrary multivariate Laurent polynomial terms without any prior information on the order. Our approach is first evaluated on a subset of data used in SRBench, a benchmark for symbolic regression. We first show that GINN-LP outperforms the state-of-the-art symbolic regression methods on datasets generated using 48 real-world equations in the form of multivariate Laurent polynomials. Next, we propose an ensemble method that combines our method with a high-performing symbolic regression method, enabling us to discover non-Laurent polynomial equations. We achieve state-of-the-art results in equation discovery, showing an absolute improvement of 7.1% over the best contender, by applying this ensemble method to 113 datasets within SRBench with known ground-truth equations.


title: A Note on Graph Burning of Path Forests

abstract: Graph burning is a natural discrete graph algorithm inspired by the spread of social contagion. Despite its simplicity, some open problems remain steadfastly unsolved, notably the burning number conjecture, which says that every connected graph of order $m^2$ has burning number at most $m$. Earlier, we showed that the conjecture also holds for a path forest, which is disconnected, provided each of its paths is sufficiently long. However, finding the least sufficient length for this to hold turns out to be nontrivial. In this note, we present our initial findings and conjectures that associate the problem to some naturally impossibly burnable path forests. It is noteworthy that our problem can be reformulated as a topic concerning sumset partition of integers.


title: Relaxation schemes for entropy dissipative system of viscous conservation laws

abstract: In this paper, we introduce a hyperbolic model for entropy dissipative system of viscous conservation laws via a flux relaxation approach. We develop numerical schemes for the resulting hyperbolic relaxation system by employing the finite-volume methodology used in the community of hyperbolic conservation laws, e.g., the generalized Riemann problem method. For fully discrete schemes for the relaxation system of scalar viscous conservation laws, we show the asymptotic preserving property in the coarse regime without resolving the relaxation scale and prove the dissipation property by using the modified equation approach. Further, we extend the idea to the compressible Navier-Stokes equations. Finally, we display the performance of our relaxation schemes by a number of numerical experiments.


title: MEG Evidence That Modality-Independent Conceptual Representations Encode Visual but Not Lexical Representations

abstract: The semantic knowledge stored in our brains can be accessed from different stimulus modalities. For example, a picture of a cat and the word "cat" both engage similar conceptual representations. While existing research has found evidence for modality-independent representations, their content remains unknown. Modality-independent representations could be abstract, or they might be perceptual or even lexical in nature. We used a novel approach combining word/picture cross-condition decoding with neural network classifiers that learned latent modality-independent representations from MEG data. We then compared these representations to models representing semantic, sensory, and lexical features. Results show that modality-independent representations are not strictly amodal; rather, they also contain visual representations. There was no evidence that lexical properties contributed to the representation of modality-independent concepts. These findings support the notion that perceptual processes play a fundamental role in encoding modality-independent conceptual representations. Conversely, lexical representations did not appear to partake in modality-independent semantic knowledge.


title: Semi-Supervised Clustering via Structural Entropy with Different Constraints

abstract: Semi-supervised clustering techniques have emerged as valuable tools for leveraging prior information in the form of constraints to improve the quality of clustering outcomes. Despite the proliferation of such methods, the ability to seamlessly integrate various types of constraints remains limited. While structural entropy has proven to be a powerful clustering approach with wide-ranging applications, it has lacked a variant capable of accommodating these constraints. In this work, we present Semi-supervised clustering via Structural Entropy (SSE), a novel method that can incorporate different types of constraints from diverse sources to perform both partitioning and hierarchical clustering. Specifically, we formulate a uniform view for the commonly used pairwise and label constraints for both types of clustering. Then, we design objectives that incorporate these constraints into structural entropy and develop tailored algorithms for their optimization. We evaluate SSE on nine clustering datasets and compare it with eleven semi-supervised partitioning and hierarchical clustering methods. Experimental results demonstrate the superiority of SSE on clustering accuracy with different types of constraints. Additionally, the functionality of SSE for biological data analysis is demonstrated by cell clustering experiments conducted on four single-cell RNAseq datasets.


title: Visualizing High-Dimensional Configuration Spaces: A Comprehensive Analytical Approach

abstract: The representation of a Configuration Space C plays a vital role in accelerating the finding of a collision-free path for sampling-based motion planners where the majority of computation time is spent in collision checking of states. Traditionally, planners evaluate C's representations through limited evaluations of collision-free paths using the collision checker or by reducing the dimensionality of C for visualization. However, a collision checker may indicate high accuracy even when only a subset of the original C is represented; limiting the motion planner's ability to find paths comparable to those in the original C. Additionally, dealing with high-dimensional Cs is challenging, as qualitative evaluations become increasingly difficult in dimensions higher than three, where reduced-dimensional C evaluation may decrease accuracy in cluttered environments. In this paper, we present a novel approach for visualizing representations of high-dimensional Cs of manipulator robots in a 2D format. We provide a new tool for qualitative evaluation of high-dimensional Cs approximations without reducing the original dimension. This enhances our ability to compare the accuracy and coverage of two different high-dimensional Cs. Leveraging the kinematic chain of manipulator robots and human color perception, we show the efficacy of our method using a 7-degree-of-freedom CS of a manipulator robot. This visualization offers qualitative insights into the joint boundaries of the robot and the coverage of collision state combinations without reducing the dimensionality of the original data. To support our claim, we conduct a numerical evaluation of the proposed visualization.


title: IoT Ground Sensing Systems for Early Wildfire Detection: Technologies, Challenges and Opportunities

abstract: The threat posed by wildfires or bushfires has become a severe global issue due to the increase in human activities in forested areas and the impact of climate change. Consequently, there is a surge in the development of automatic wildfire detection methods. Approaches based on long-distance imagery from satellites or watchtowers encounter limitations, such as restricted visibility, which results in delayed response times. To address and overcome these challenges, research interest has grown in the implementation of ground-based Internet of Things (IoT) sensing systems for early wildfire detection. However, research on energy consumption, detection latency, and detection accuracy of IoT sensing systems, as well as the performance of various anomaly detection algorithms when evaluated using these metrics, is lacking. Therefore, in this article, we present an overview of current IoT ground sensing systems for early wildfire detection. Camera and environmental sensing technologies suitable for early wildfire detection are discussed, as well as vision-based detection algorithms and detection algorithms for environmental sensing. Challenges related to the development and implementation of IoT ground sensing systems for early wildfire detection and the future research directions important for creating a robust detection system to combat the growing threat of wildfires worldwide are discussed.


title: Domain adaption and physical constrains transfer learning for shale gas production

abstract: Effective prediction of shale gas production is crucial for strategic reservoir development. However, in new shale gas blocks, two main challenges are encountered: (1) the occurrence of negative transfer due to insufficient data, and (2) the limited interpretability of deep learning (DL) models. To tackle these problems, we propose a novel transfer learning methodology that utilizes domain adaptation and physical constraints. This methodology effectively employs historical data from the source domain to reduce negative transfer from the data distribution perspective, while also using physical constraints to build a robust and reliable prediction model that integrates various types of data. The methodology starts by dividing the production data from the source domain into multiple subdomains, thereby enhancing data diversity. It then uses Maximum Mean Discrepancy (MMD) and global average distance measures to decide on the feasibility of transfer. Through domain adaptation, we integrate all transferable knowledge, resulting in a more comprehensive target model. Lastly, by incorporating drilling, completion, and geological data as physical constraints, we develop a hybrid model. This model, a combination of a multi-layer perceptron (MLP) and a Transformer (Transformer-MLP), is designed to maximize interpretability. Experimental validation in China's southwestern region confirms the method's effectiveness.


title: AE-NeRF: Audio Enhanced Neural Radiance Field for Few Shot Talking Head Synthesis

abstract: Audio-driven talking head synthesis is a promising topic with wide applications in digital human, film making and virtual reality. Recent NeRF-based approaches have shown superiority in quality and fidelity compared to previous studies. However, when it comes to few-shot talking head generation, a practical scenario where only few seconds of talking video is available for one identity, two limitations emerge: 1) they either have no base model, which serves as a facial prior for fast convergence, or ignore the importance of audio when building the prior; 2) most of them overlook the degree of correlation between different face regions and audio, e.g., mouth is audio related, while ear is audio independent. In this paper, we present Audio Enhanced Neural Radiance Field (AE-NeRF) to tackle the above issues, which can generate realistic portraits of a new speaker with fewshot dataset. Specifically, we introduce an Audio Aware Aggregation module into the feature fusion stage of the reference scheme, where the weight is determined by the similarity of audio between reference and target image. Then, an Audio-Aligned Face Generation strategy is proposed to model the audio related and audio independent regions respectively, with a dual-NeRF framework. Extensive experiments have shown AE-NeRF surpasses the state-of-the-art on image fidelity, audio-lip synchronization, and generalization ability, even in limited training set or training iterations.


title: NTrack: A Multiple-Object Tracker and Dataset for Infield Cotton Boll Counting

abstract: In agriculture, automating the accurate tracking of fruits, vegetables, and fiber is a very tough problem. The issue becomes extremely challenging in dynamic field environments. Yet, this information is critical for making day-to-day agricultural decisions, assisting breeding programs, and much more. To tackle this dilemma, we introduce NTrack, a novel multiple object tracking framework based on the linear relationship between the locations of neighboring tracks. NTrack computes dense optical flow and utilizes particle filtering to guide each tracker. Correspondences between detections and tracks are found through data association via direct observations and indirect cues, which are then combined to obtain an updated observation. Our modular multiple object tracking system is independent of the underlying detection method, thus allowing for the interchangeable use of any off-the-shelf object detector. We show the efficacy of our approach on the task of tracking and counting infield cotton bolls. Experimental results show that our system exceeds contemporary tracking and cotton boll-based counting methods by a large margin. Furthermore, we publicly release the first annotated cotton boll video dataset to the research community.


title: Cuntz-Nica-Pimsner algebras of product systems over groupoids

abstract: Let $X$ be a product system over a quasi-lattice ordered groupoid $(G,P)$. Under mild hypotheses, we associate to $X$ a $C^*$-algebra which is couniversal for injective Nica covariant Toeplitz representations of $X$ which preserve the gauge coaction. When $(G,P)$ is a quasi-lattice ordered group this couniversal $C^*$-algebra coincides with the Cuntz-Nica-Pimsner algebra introduced by Carlsen-Larsen-Sims-Vittadello, and under some mild amenability conditions with that of Sims and Yeend. We prove related gauge invariant uniqueness theorems in this general setup.


title: Bayesian Analysis of a Generalized Starobinsky Model with Reheating Constraints

abstract: We study a generalization of the the Starobinsky model adding a term of the form $R^{2p}$ to the Einstien-Hilbert action. We take the power $p$ as a parameter of the model and explore the constraints from CMB plus BAO data through a Bayesian analysis, thus exploring a range of values for the exponent parameter. We incorporate a reheating phase to the model through the background matter content (equation of state) and the duration of this period (number of $e$-foldings of reheating). We find that incorporating information from reheating imposes constraints on cosmological quantities, more stringent than the case of no reheating when tested with the Planck+BAO data. The inferred value of the exponent parameter is statistically consistent with $p=1$, favoring the original Starobinsky potential. Moreover, we report tighter constraints on $p$ and the number of $e$-folds in comparison with previous works. The obtained values for other inflationary observational parameters, such as the scalar spectral index $n_s$ and the scalar amplitude of perturbations $A_s$, are consistent with prior measurements. Finally we present the alternative use of consistency relations in order to simplify the parameter space and test the generalized Starobinsky potential even more efficiently.


title: Delving Deeper Into Astromorphic Transformers

abstract: Preliminary attempts at incorporating the critical role of astrocytes - cells that constitute more than 50% of human brain cells - in brain-inspired neuromorphic computing remain in infancy. This paper seeks to delve deeper into various key aspects of neuron-synapse-astrocyte interactions to mimic self-attention mechanisms in Transformers. The cross-layer perspective explored in this work involves bio-plausible modeling of Hebbian and pre-synaptic plasticities in neuron-astrocyte networks, incorporating effects of non-linearities and feedback along with algorithmic formulations to map the neuron-astrocyte computations to self-attention mechanism and evaluating the impact of incorporating bio-realistic effects from the machine learning application side. Our analysis on sentiment and image classification tasks on the IMDB and CIFAR10 datasets underscores the importance of constructing Astromorphic Transformers from both accuracy and learning speed improvement perspectives.


title: A Random Effects Model-based Method of Moments Estimation of Causal Effect in Mendelian Randomization Studies

abstract: Recent advances in genotyping technology have delivered a wealth of genetic data, which is rapidly advancing our understanding of the underlying genetic architecture of complex diseases. Mendelian Randomization (MR) leverages such genetic data to estimate the causal effect of an exposure factor on an outcome from observational studies. In this paper, we utilize genetic correlations to summarize information on a large set of genetic variants associated with the exposure factor. Our proposed approach is a generalization of the MR-inverse variance weighting (IVW) approach where we can accommodate many weak and pleiotropic effects. Our approach quantifies the variation explained by all valid instrumental variables (IVs) instead of estimating the individual effects and thus could accommodate weak IVs. This is particularly useful for performing MR estimation in small studies, or minority populations where the selection of valid IVs is unreliable and thus has a large influence on the MR estimation. Through simulation and real data analysis, we demonstrate that our approach provides a robust alternative to the existing MR methods. We illustrate the robustness of our proposed approach under the violation of MR assumptions and compare the performance with several existing approaches.


title: Non-Abelian chiral soliton lattice in rotating QCD matter: Nambu-Goldstone and excited modes

abstract: The ground state of QCD with two flavors at a finite baryon chemical potential under rapid rotation is a chiral soliton lattice (CSL) of the $\eta$ meson, consisting of a stack of sine-Gordon solitons carrying a baryon number, due to the anomalous coupling of the $\eta$ meson to the rotation. In a large parameter region, the ground state becomes a non-Abelian CSL, in which due to the neutral pion condensation each $\eta$ soliton decays into a pair of non-Abelian sine-Gordon solitons carrying $S^2$ moduli originated from Nambu-Goldstone (NG) modes localized around it, corresponding to the spontaneously broken vector symmetry SU$(2)_{\rm V}$. There, the $S^2$ modes of neighboring solitons are anti-aligned, and these modes should propagate in the transverse direction of the lattice due to the interaction between the $S^2$ modes of neighboring solitons. In this paper, we calculate excitations including gapless NG modes and excited modes around non-Abelian and Abelian ($\eta$) CSLs, and find three gapless NG modes with linear dispersion relations (type-A NG modes): two isospinons ($S^2$ modes) and a phonon corresponding to the spontaneously broken vector SU$(2)_{\rm V}$ and translational symmetries around the non-Abelian CSL, respectively, and only a phonon for the Abelian CSL because of the recovering SU$(2)_{\rm V}$. We also find in the deconfined phase that the dispersion relation of the isospinons becomes of the Dirac type, {\it i.~e.~} linear even at large momentum.


title: An essay on deformation measures in isotropic thin shell theories. Bending versus curvature

abstract: It has become commonplace for the stored energy function of any realistic shell model to align ``within first order" with the classical Koiter membrane-bending (flexural) shell model. In this paper, we assess whether certain extended Cosserat shell models are consistent with the classical linear Koiter model. In doing this, we observe that there are numerous reasons why a modified version of the classical Koiter model should be considered, a consensus reached not only by Koiter himself but also by Sanders and Budiansky, who independently developed the same theory during the same period. To provide a comprehensive overview of the strain measures employed in our Cosserat shell models, this paper presents them in a unified manner and compares them with the strain measures previously utilized in the literature. We show that all our new strain tensors either generalize (in the case of nonlinear constrained or unconstrained models) or coincide (in the case of the linear constrained model) with the strain tensors recognized as the ``best" or those possessing a well-defined geometric interpretation connected to bending or curvature.


title: Capture components of cubic Siegel polynomials

abstract: Let $\theta$ be an irrational number of bounded type. We prove that all capture components in the parameter space of cubic polynomials $f_a(z)=e^{2\pi i\theta}z+a z^2+z^3$, where $a\in\mathbb{C}$, are Jordan domains.


title: Deep Learning Approaches for Seizure Video Analysis: A Review

abstract: Seizure events can manifest as transient disruptions in the control of movements which may be organized in distinct behavioral sequences, accompanied or not by other observable features such as altered facial expressions. The analysis of these clinical signs, referred to as semiology, is subject to observer variations when specialists evaluate video-recorded events in the clinical setting. To enhance the accuracy and consistency of evaluations, computer-aided video analysis of seizures has emerged as a natural avenue. In the field of medical applications, deep learning and computer vision approaches have driven substantial advancements. Historically, these approaches have been used for disease detection, classification, and prediction using diagnostic data; however, there has been limited exploration of their application in evaluating video-based motion detection in the clinical epileptology setting. While vision-based technologies do not aim to replace clinical expertise, they can significantly contribute to medical decision-making and patient care by providing quantitative evidence and decision support. Behavior monitoring tools offer several advantages such as providing objective information, detecting challenging-to-observe events, reducing documentation efforts, and extending assessment capabilities to areas with limited expertise. The main applications of these could be (1) improved seizure detection methods; (2) refined semiology analysis for predicting seizure type and cerebral localization. In this paper, we detail the foundation technologies used in vision-based systems in the analysis of seizure videos, highlighting their success in semiology detection and analysis, focusing on work published in the last 7 years. Additionally, we illustrate how existing technologies can be interconnected through an integrated system for video-based semiology analysis.


title: An Examination of Polarization Mode Transitions in Pulsar Radio Emission

abstract: A statistical model is used to determine how stochastic fluctuations in the intensities of orthogonal polarization modes contribute to the modulation and depolarization of pulsar radio emission. General expressions for the distributions of the Stokes parameters, linear polarization, polarization position angle, and fractional polarization are derived when the mode intensities follow the same or different probability distributions. The transition between modes is examined. When the mode intensities follow the same distribution, the fractional linear polarization and modulation index are symmetric about the transition. The symmetry is disrupted when the mode intensities follow different distributions. The fractional linear polarization is minimum and the mode frequency of occurrence changes rapidly at transitions where the mode intensity distributions are the same and the modulation index is small. A lower limit on the fractional linear polarization that can be attained via the simultaneous occurrence of the modes as a function of modulation index is quantified.


title: A Shape Detection Framework for Deformation Objects Using Clustering Algorithms

abstract: This paper uses clustering algorithms to introduce a shape framework for deformable objects. Until now, the shape detection of the deformable objects has faced several challenges: 1) unable to form a unified framework for multiple shapes; 2) the calculation burden as a large number of calculations; 3) the inability to solve the 3D point-cloud case. A novel shape detection framework for deformable objects is presented in this paper, which only uses the input 2D-pixel data of the objects without any artificial markers. The proposed detection approach runs in a highly real-time manner. For the definitions of the shapes of the deformable objects, three shape configurations are used to describe the outlines of the objects, i.e., centerline, contour, and surface. In addition, for the obtaining of the 3D shape, Different from the traditional 3D point cloud processing method, this article uses a one-to-one mapping method between 2D-pixel points and 3D shape points. Therefore, this guarantees a one-to-one correspondence between 2D and 3D shape points. Hence, the proposed approach can enhance the autonomous capability to detect the shape of deformable objects. Detailed experimental results are conducted within the centerline configuration to evaluate the effectiveness of the proposed shape detection framework.


title: SeeBel: Seeing is Believing

abstract: Semantic Segmentation is a significant research field in Computer Vision. Despite being a widely studied subject area, many visualization tools do not exist that capture segmentation quality and dataset statistics such as a class imbalance in the same view. While the significance of discovering and introspecting the correlation between dataset statistics and AI model performance for dense prediction computer vision tasks such as semantic segmentation is well established in the computer vision literature, to the best of our knowledge, no visualization tools have been proposed to view and analyze the aforementioned tasks. Our project aims to bridge this gap by proposing three visualizations that enable users to compare dataset statistics and AI performance for segmenting all images, a single image in the dataset, explore the AI model's attention on image regions once trained and browse the quality of masks predicted by AI for any selected (by user) number of objects under the same tool. Our project tries to further increase the interpretability of the trained AI model for segmentation by visualizing its image attention weights. For visualization, we use Scatterplot and Heatmap to encode correlation and features, respectively. We further propose to conduct surveys on real users to study the efficacy of our visualization tool in computer vision and AI domain. The full system can be accessed at https://github.com/dipta007/SeeBel


title: APIDocBooster: An Extract-Then-Abstract Framework Leveraging Large Language Models for Augmenting API Documentation

abstract: API documentation is often the most trusted resource for programming. Many approaches have been proposed to augment API documentation by summarizing complementary information from external resources such as Stack Overflow. Existing extractive-based summarization approaches excel in producing faithful summaries that accurately represent the source content without input length restrictions. Nevertheless, they suffer from inherent readability limitations. On the other hand, our empirical study on the abstractive-based summarization method, i.e., GPT-4, reveals that GPT-4 can generate coherent and concise summaries but presents limitations in terms of informativeness and faithfulness. We introduce APIDocBooster, an extract-then-abstract framework that seamlessly fuses the advantages of both extractive (i.e., enabling faithful summaries without length limitation) and abstractive summarization (i.e., producing coherent and concise summaries). APIDocBooster consists of two stages: (1) \textbf{C}ontext-aware \textbf{S}entence \textbf{S}ection \textbf{C}lassification (CSSC) and (2) \textbf{UP}date \textbf{SUM}marization (UPSUM). CSSC classifies API-relevant information collected from multiple sources into API documentation sections. UPSUM first generates extractive summaries distinct from the original API documentation and then generates abstractive summaries guided by extractive summaries through in-context learning. To enable automatic evaluation of APIDocBooster, we construct the first dataset for API document augmentation. Our automatic evaluation results reveal that each stage in APIDocBooster outperforms its baselines by a large margin. Our human evaluation also demonstrates the superiority of APIDocBooster over GPT-4 and shows that it improves informativeness, relevance, and faithfulness by 13.89\%, 15.15\%, and 30.56\%, respectively.


title: AEDFL: Efficient Asynchronous Decentralized Federated Learning with Heterogeneous Devices

abstract: Federated Learning (FL) has achieved significant achievements recently, enabling collaborative model training on distributed data over edge devices. Iterative gradient or model exchanges between devices and the centralized server in the standard FL paradigm suffer from severe efficiency bottlenecks on the server. While enabling collaborative training without a central server, existing decentralized FL approaches either focus on the synchronous mechanism that deteriorates FL convergence or ignore device staleness with an asynchronous mechanism, resulting in inferior FL accuracy. In this paper, we propose an Asynchronous Efficient Decentralized FL framework, i.e., AEDFL, in heterogeneous environments with three unique contributions. First, we propose an asynchronous FL system model with an efficient model aggregation method for improving the FL convergence. Second, we propose a dynamic staleness-aware model update approach to achieve superior accuracy. Third, we propose an adaptive sparse training method to reduce communication and computation costs without significant accuracy degradation. Extensive experimentation on four public datasets and four models demonstrates the strength of AEDFL in terms of accuracy (up to 16.3% higher), efficiency (up to 92.9% faster), and computation costs (up to 42.3% lower).


title: Families of Harris Graphs

abstract: A Harris Graph is a tough, Eulerian, non-Hamiltonian graph. Several approaches to creating new Harris graphs from existing ones are explored, including creating families of Harris graphs and combining Harris graphs. Pictures of all Harris Graphs through order 9 and the number of Harris graphs through order 12 are included. We also prove a result about barnacle-free Harris graphs.


title: An Extended Variational Mode Decomposition Algorithm Developed Speech Emotion Recognition Performance

abstract: Emotion recognition (ER) from speech signals is a robust approach since it cannot be imitated like facial expression or text based sentiment analysis. Valuable information underlying the emotions are significant for human-computer interactions enabling intelligent machines to interact with sensitivity in the real world. Previous ER studies through speech signal processing have focused exclusively on associations between different signal mode decomposition methods and hidden informative features. However, improper decomposition parameter selections lead to informative signal component losses due to mode duplicating and mixing. In contrast, the current study proposes VGG-optiVMD, an empowered variational mode decomposition algorithm, to distinguish meaningful speech features and automatically select the number of decomposed modes and optimum balancing parameter for the data fidelity constraint by assessing their effects on the VGG16 flattening output layer. Various feature vectors were employed to train the VGG16 network on different databases and assess VGG-optiVMD reproducibility and reliability. One, two, and three-dimensional feature vectors were constructed by concatenating Mel-frequency cepstral coefficients, Chromagram, Mel spectrograms, Tonnetz diagrams, and spectral centroids. Results confirmed a synergistic relationship between the fine-tuning of the signal sample rate and decomposition parameters with classification accuracy, achieving state-of-the-art 96.09% accuracy in predicting seven emotions on the Berlin EMO-DB database.


title: Influence of initial states on memory effects: A study of early-time superradiance

abstract: The initial state of a quantum system can significantly influence its future dynamics, especially in non-Markovain quantum processes due to the environmental memory effects. Based on a previous work of ours, we propose a method to quantify the memory effects of a non-Markovian quantum process conditioned on a particular system initial state. We apply our method to study the early-time dynamics of a superradiance model where $N$ atoms (the system) interacting with a single-mode vacuum cavity (the environment) with several types of initial states. We find that the value of the memory effects in the early-time regime is half the environmental photon number for the (dephased) Dicke states. Besides, the memory effects, the environmental photon number and the degree of superradiance can be simultaneously enhanced by the coherence or entanglement of some initial states. In our study, the transitions from non-superradiant initial states to superradiant ones are always accompanied by the enhancement of memory effects, showing the importance of memory effects in superradiance.


title: The homology groups of finite cyclic covering of line arrangement complement

abstract: In this paper, we study the first homology group of finite cyclic covering of complex line arrangement complement. We show that this first integral homology group is torsion-free under certain condition similar to the one used by Cohen-Dimca-Orlik. In particular, this includes the case of the Milnor fiber, which generalizes the previous results obtained by Williams for complexified line arrangement to any complex line arrangement.


title: Rigidity of area non-increasing maps

abstract: In this work, we consider the area non-increasing map between manifolds with positive curvature. By exploring the strong maximum principle along the graphical mean curvature flow, we show that an area non-increasing map between certain positively curved manifolds is either homotopy trivial, Riemannian submersion, local isometry or isometric immersion. This implies that an area non-increasing self map of $\mathbb{CP}^n$, $n\ge 2$ is either homotopically trivial or is an isometry. This confirms a speculation of Tsai-Tsui-Wang. We also use Brendle's sphere Theorem and mean curvature flow coupled with Ricci flow to establish related results on manifolds with positive $1$-isotropic curvature.


title: Behaviour Description Database for AVs in Singapore

abstract: A Technical Reference for Autonomous Vehicles (AVs), with part 1 focusing on basic behaviour guidelines (TR68-1) is published with the intent to be a reference for evaluation of appropriated behaviour on Autonomous Vehicles for Singapore. This is based on applicability from Basic Theory of Driving (BTD) and Final Theory of Driving (FTD) which are the traffic code/rules for human driving. This report contains a consolidation of current guidelines from TR68-1, BTD and FTD. It will allow an initial identification of missing guidelines for AV behaviour on roads; however, it is difficult to identify conflicting rules or gaps in guidance without going into identified traffic situations. Identified situations for analysis were chosen from Centre of Excellence for Testing & Research of Autonomous Vehicle (CETRAN) assessment experience for further investigation. The outcome of the report proposes additional behaviour characteristics and guidelines to situations identified to close the gap between assessors and developers on expected AV behaviour. These recommendations could improve current guidelines for AV behavioural in assessment and generally for the local AV ecosystem for urban tropical roads in Singapore. These recommendations could also serve as inputs for future TR 68-1 revisions where a sample set of reference situations can help to define clearer expectations or requirements for AV behaviour in those situations. This will help Singapore push forward in better definition of the expected AV behaviour for AV systems.


title: ShuttleSHAP: A Turn-Based Feature Attribution Approach for Analyzing Forecasting Models in Badminton

abstract: Agent forecasting systems have been explored to investigate agent patterns and improve decision-making in various domains, e.g., pedestrian predictions and marketing bidding. Badminton represents a fascinating example of a multifaceted turn-based sport, requiring both sophisticated tactic developments and alternate-dependent decision-making. Recent deep learning approaches for player tactic forecasting in badminton show promising performance partially attributed to effective reasoning about rally-player interactions. However, a critical obstacle lies in the unclear functionality of which features are learned for simulating players' behaviors by black-box models, where existing explainers are not equipped with turn-based and multi-output attributions. To bridge this gap, we propose a turn-based feature attribution approach, ShuttleSHAP, for analyzing forecasting models in badminton based on variants of Shapley values. ShuttleSHAP is a model-agnostic explainer that aims to quantify contribution by not only temporal aspects but also player aspects in terms of multifaceted cues. Incorporating the proposed analysis tool into the state-of-the-art turn-based forecasting model on the benchmark dataset reveals that it is, in fact, insignificant to reason about past strokes, while conventional sequential models have greater impacts. Instead, players' styles influence the models for the future simulation of a rally. On top of that, we investigate and discuss the causal analysis of these findings and demonstrate the practicability with local analysis.


title: Model Stealing Attack against Graph Classification with Authenticity, Uncertainty and Diversity

abstract: Recent research demonstrates that GNNs are vulnerable to the model stealing attack, a nefarious endeavor geared towards duplicating the target model via query permissions. However, they mainly focus on node classification tasks, neglecting the potential threats entailed within the domain of graph classification tasks. Furthermore, their practicality is questionable due to unreasonable assumptions, specifically concerning the large data requirements and extensive model knowledge. To this end, we advocate following strict settings with limited real data and hard-label awareness to generate synthetic data, thereby facilitating the stealing of the target model. Specifically, following important data generation principles, we introduce three model stealing attacks to adapt to different actual scenarios: MSA-AU is inspired by active learning and emphasizes the uncertainty to enhance query value of generated samples; MSA-AD introduces diversity based on Mixup augmentation strategy to alleviate the query inefficiency issue caused by over-similar samples generated by MSA-AU; MSA-AUD combines the above two strategies to seamlessly integrate the authenticity, uncertainty, and diversity of the generated samples. Finally, extensive experiments consistently demonstrate the superiority of the proposed methods in terms of concealment, query efficiency, and stealing performance.


title: From Whole-slide Image to Biomarker Prediction: A Protocol for End-to-End Deep Learning in Computational Pathology

abstract: Hematoxylin- and eosin (H&E) stained whole-slide images (WSIs) are the foundation of diagnosis of cancer. In recent years, development of deep learning-based methods in computational pathology enabled the prediction of biomarkers directly from WSIs. However, accurately linking tissue phenotype to biomarkers at scale remains a crucial challenge for democratizing complex biomarkers in precision oncology. This protocol describes a practical workflow for solid tumor associative modeling in pathology (STAMP), enabling prediction of biomarkers directly from WSIs using deep learning. The STAMP workflow is biomarker agnostic and allows for genetic- and clinicopathologic tabular data to be included as an additional input, together with histopathology images. The protocol consists of five main stages which have been successfully applied to various research problems: formal problem definition, data preprocessing, modeling, evaluation and clinical translation. The STAMP workflow differentiates itself through its focus on serving as a collaborative framework that can be used by clinicians and engineers alike for setting up research projects in the field of computational pathology. As an example task, we applied STAMP to the prediction of microsatellite instability (MSI) status in colorectal cancer, showing accurate performance for the identification of MSI-high tumors. Moreover, we provide an open-source codebase which has been deployed at several hospitals across the globe to set up computational pathology workflows. The STAMP workflow requires one workday of hands-on computational execution and basic command line knowledge.


title: LaViP:Language-Grounded Visual Prompts

abstract: We introduce a language-grounded visual prompting method to adapt the visual encoder of vision-language models for downstream tasks. By capitalizing on language integration, we devise a parameter-efficient strategy to adjust the input of the visual encoder, eliminating the need to modify or add to the model's parameters. Due to this design choice, our algorithm can operate even in black-box scenarios, showcasing adaptability in situations where access to the model's parameters is constrained. We will empirically demonstrate that, compared to prior art, grounding visual prompts with language enhances both the accuracy and speed of adaptation. Moreover, our algorithm excels in base-to-novel class generalization, overcoming limitations of visual prompting and exhibiting the capacity to generalize beyond seen classes. We thoroughly assess and evaluate our method across a variety of image recognition datasets, such as EuroSAT, UCF101, DTD, and CLEVR, spanning different learning situations, including few-shot learning, base-to-novel class generalization, and transfer learning.