title: Learning Detailed Radiance Manifolds for High-Fidelity and 3D-Consistent Portrait Synthesis from Monocular Image

abstract: A key challenge for novel view synthesis of monocular portrait images is 3D consistency under continuous pose variations. Most existing methods rely on 2D generative models which often leads to obvious 3D inconsistency artifacts. We present a 3D-consistent novel view synthesis approach for monocular portrait images based on a recent proposed 3D-aware GAN, namely Generative Radiance Manifolds (GRAM), which has shown strong 3D consistency at multiview image generation of virtual subjects via the radiance manifolds representation. However, simply learning an encoder to map a real image into the latent space of GRAM can only reconstruct coarse radiance manifolds without faithful fine details, while improving the reconstruction fidelity via instance-specific optimization is time-consuming. We introduce a novel detail manifolds reconstructor to learn 3D-consistent fine details on the radiance manifolds from monocular images, and combine them with the coarse radiance manifolds for high-fidelity reconstruction. The 3D priors derived from the coarse radiance manifolds are used to regulate the learned details to ensure reasonable synthesized results at novel views. Trained on in-the-wild 2D images, our method achieves high-fidelity and 3D-consistent portrait synthesis largely outperforming the prior art.


title: TAOTF: A Two-stage Approximately Orthogonal Training Framework in Deep Neural Networks

abstract: The orthogonality constraints, including the hard and soft ones, have been used to normalize the weight matrices of Deep Neural Network (DNN) models, especially the Convolutional Neural Network (CNN) and Vision Transformer (ViT), to reduce model parameter redundancy and improve training stability. However, the robustness to noisy data of these models with constraints is not always satisfactory. In this work, we propose a novel two-stage approximately orthogonal training framework (TAOTF) to find a trade-off between the orthogonal solution space and the main task solution space to solve this problem in noisy data scenarios. In the first stage, we propose a novel algorithm called polar decomposition-based orthogonal initialization (PDOI) to find a good initialization for the orthogonal optimization. In the second stage, unlike other existing methods, we apply soft orthogonal constraints for all layers of DNN model. We evaluate the proposed model-agnostic framework both on the natural image and medical image datasets, which show that our method achieves stable and superior performances to existing methods.


title: Possible helimagnetic order in Co4+-containing perovskites Sr1-xCaxCoO3

abstract: We systematically synthesized perovskite-type oxides Sr1-xCaxCoO3 containing unusually high valence Co4+ ions by a high pressure technique, and investigated the effect of systematic lattice change on the magnetic and electronic properties. As the Ca content x exceeds about 0.6, the structure changes from cubic to orthorhombic, which is supported by the first-principles calculations of enthalpy. Upon the orthorhombic distortion, the ground state remains to be apparently ferromagnetic with a slight drop of the Curie temperature. Importantly, the compounds with x larger than 0.8 show antiferromagnetic behavior with positive Weiss temperatures and nonlinear magnetization curves at lowest temperature, implying that the ground state is noncollinear antiferromagnetic or helimagnetic. Considering the incoherent metallic behavior and the suppression of the electronic specific heat at high x region, the possible emergence of a helimagnetic state in Sr1-xCaxCoO3 is discussed in terms of the band-width narrowing and the double-exchange mechanism with the negative charge transfer energy as well as the spin frustration owing to the next-nearest neighbor interaction.


title: Policy-Adaptive Estimator Selection for Off-Policy Evaluation

abstract: Off-policy evaluation (OPE) aims to accurately evaluate the performance of counterfactual policies using only offline logged data. Although many estimators have been developed, there is no single estimator that dominates the others, because the estimators' accuracy can vary greatly depending on a given OPE task such as the evaluation policy, number of actions, and noise level. Thus, the data-driven estimator selection problem is becoming increasingly important and can have a significant impact on the accuracy of OPE. However, identifying the most accurate estimator using only the logged data is quite challenging because the ground-truth estimation accuracy of estimators is generally unavailable. This paper studies this challenging problem of estimator selection for OPE for the first time. In particular, we enable an estimator selection that is adaptive to a given OPE task, by appropriately subsampling available logged data and constructing pseudo policies useful for the underlying estimator selection task. Comprehensive experiments on both synthetic and real-world company data demonstrate that the proposed procedure substantially improves the estimator selection compared to a non-adaptive heuristic.


title: A Scalable Bilevel Framework for Renewable Energy Scheduling

abstract: Accommodating the uncertain and variable renewable energy sources (VRES) in electricity markets requires sophisticated and scalable tools to achieve market efficiency. To account for the uncertain imbalance costs in the real-time market while remaining compatible with the existing sequential market-clearing structure, our work adopts an uncertainty-informed adjustment toward the VRES contract quantity scheduled in the day-ahead market. This mechanism requires solving a bilevel problem, which is computationally challenging for practical large-scale systems. To improve the scalability, we propose a technique based on strong duality and McCormick envelopes, which relaxes the original problem to linear programming. We conduct numerical studies on both IEEE 118-bus and 1814-bus NYISO systems. Results show that the proposed relaxation can achieve good performance in accuracy (0.7%-gap in the system cost wrt. the least-cost stochastic clearing benchmark) and scalability (solving the NYISO system in minutes). Furthermore, the benefit of this bilevel VRES-quantity adjustment is more significant under higher penetration levels of VRES (e.g., 70%), under which the system cost can be reduced substantially compared to a myopic day-ahead offer strategy of VRES.


title: Non-Hermitian eigenvalue knots and their isotopic equivalence

abstract: The spectrum of a non-Hermitian system generically forms a two-dimensional complex Riemannian manifold with distinct topology from the underlying parameter space. Spectral topology permits parametric loops to map the affiliated eigenvalue trajectories into knots. In this work, through analyzing exceptional points and their topology, we uncover the necessary considerations for constructing eigenvalue knots and establish their relation to spectral topology. Using an acoustic system with two periodic synthetic dimensions, we experimentally realize several knots with braid index 3. In addition, by highlighting the role of branch cuts on the eigenvalue manifolds, we show that eigenvalue knots produced by homotopic parametric loops are isotopic such that they can deform into one another by type-II or type-III Reidemeister moves. Our results not only provide a general recipe for constructing eigenvalue knots but also expand the current understanding of eigenvalue knots by showing that they contain information beyond that of the spectral topology.


title: Blockchain based solution design for Energy Exchange Platform

abstract: It is observed that users have higher requirements for fairness, transparency, and privacy of transactions of energy exchanges that occur across platforms like Indian Energy Exchange (IEX) and Power Exchange India Limited (PXIL). As a decentralized distributed accounting system, blockchain is characterized by traceability, security, credibility, and non-tampering of transactions, which can meet the needs of integrated energy and multi-energy transactions. Based on the research on the application of blockchain technology in the field of integrated energy services, this solution proposes an integrated energy trading process based on smart contracts and explores the application of blockchain technology in integrated energy services.


title: Fault-Tolerant Offline Multi-Agent Path Planning

abstract: We study a novel graph path planning problem for multiple agents that may crash at runtime, and block part of the workspace. In our setting, agents can detect neighboring crashed agents, and change followed paths at runtime. The objective is then to prepare a set of paths and switching rules for each agent, ensuring that all correct agents reach their destinations without collisions or deadlocks, despite unforeseen crashes of other agents. Such planning is attractive to build reliable multi-robot systems. We present problem formalization, theoretical analysis such as computational complexities, and how to solve this offline planning problem.


title: The Magic of Slow-to-Fast and Constant: Evaluating Time Perception of Progress Bars by Bayesian Model

abstract: Objective: We aimed to use adaptive psychophysics methods, which is a Bayesian Model, to measure users' time perception of various progress bar quantitatively. Background: Progress bar informs users about the status of ongoing processes. Progress bars frequently display nonuniform speed patterns, such as acceleration and deceleration. However, which progress bar is perceived faster remain unclear. Methods: We measured the point of subject equality (PSE) of the constant progress bar toward four different 5-second progress bars with a non-constant speed. To measure PSE, in each trial, a constant progress bar and a non-constant progress bar were presented to participants. Participants needed to judge which one is shorter. Based on their choice, the model generated the time duration of constant progress bar in next trial. After 40 trials for each non-constant progress bar, the PSE was calculated by the model. Eye tracking was recorded during the experiment.Results: Our results show that the constant progress bar and speed-up progress bar are perceived to be faster. The anchoring effect fits the results of our study, indicating that the final part of the progress bar is more important for time perception. Moreover, the eye-tracking results indicate that the progress bar is perceived to be slower is related to the overload of cognitive resources.Conclusion: The constant progress bar and speed-up progress bar are perceived as the quickest. Application: The results suggest that UX design can use constant or speed-up progress bar, in order to improve user experience in waiting.


title: Geodesic continued fraction for Shimura curves and its periodicity: the case of $(2,3,7)$-triangle group

abstract: In this paper we study the geodesic continued fraction in the case of the Shimura curve coming from the $(2,3,7)$-triangle group. We construct a certain continued fraction expansion of real numbers using the so-called coding of the geodesics on the Shimura curve, and prove the Lagrange type periodicity theorem for the expansion which captures the fundamental relative units of quadratic extensions of $\mathbb{Q}(\cos(2\pi/7))$ with rank one relative unit groups. We also discuss the convergence of these continued fractions.


title: First measurement of the strange axial coupling constant using neutral-current quasielastic interactions of atmospheric neutrinos at KamLAND

abstract: We report a measurement of the strange axial coupling constant $g_A^s$ using atmospheric neutrino data at KamLAND. This constant is a component of the axial form factor of the neutral-current quasielastic (NCQE) interaction. The value of $g_A^s$ significantly changes the ratio of proton and neutron NCQE cross sections. KamLAND is suitable for measuring NCQE interactions as it can detect nucleon recoils with low-energy thresholds and measure neutron multiplicity with high efficiency. KamLAND data, including the information on neutron multiplicity associated with the NCQE interactions, makes it possible to measure $g_A^s$ with a suppressed dependence on the axial mass $M_A$, which has not yet been determined. For a comprehensive prediction of the neutron emission associated with neutrino interactions, we establish a simulation of particle emission via nuclear deexcitation of $^{12}$C, a process not considered in existing neutrino Monte Carlo event generators. Energy spectrum fitting for each neutron multiplicity gives $g_A^s =-0.14^{+0.25}_{-0.26}$, which is the most stringent limit obtained using NCQE interactions without $M_A$ constraints. The two-body current contribution considered in this analysis relies on a theoretically effective model and electron scattering experiments and requires future verification by direct measurements and future model improvement.


title: Enhancing Recommender Systems: A Strategy to Mitigate False Negative Impact

abstract: In implicit collaborative filtering (CF) task of recommender systems, recent works mainly focus on model structure design with promising techniques like graph neural networks (GNNs). Effective and efficient negative sampling methods that suit these models, however, remain underdeveloped. One challenge is that existing hard negative samplers tend to suffer from severer over-fitting in model training. In this work, we first study the reason behind the over-fitting, and illustrate it with the incorrect selection of false negative instances with the support of experiments. In addition, we empirically observe a counter-intuitive phenomenon, that is, polluting hard negative samples' embeddings with a quite large proportional of positive samples' embeddings will lead to remarkable performance gains for prediction accuracy. On top of this finding, we present a novel negative sampling strategy, i.e., positive-dominated negative synthesizing (PDNS). Moreover, we provide theoretical analysis and derive a simple equivalent algorithm of PDNS, where only a soft factor is added in the loss function. Comprehensive experiments on three real-world datasets demonstrate the superiority of our proposed method in terms of both effectiveness and robustness.


title: Constants for Artin like problems in Kummer and division fields

abstract: We apply the character sums method of Lenstra, Moree, and Stevenhagen, to explicitly compute the constants in the Titchmarsh divisor problem for Kummer fields and for division fields of Serre curves. We derive our results as special cases of a general result on the product expressions for the sums in the form $$\sum_{n=1}^{\infty}\frac{g(n)}{\#G(n)}$$ in which $g(n)$ is a multiplicative arithmetic function and $\{G(n)\}$ is a certain family of Galois groups. Our results extend the application of the character sums method to the evaluation of constants, such as the Titchmarsh divisor constants, that are not density constants.


title: Unbalanced penalization: A new approach to encode inequality constraints of combinatorial problems for quantum optimization algorithms

abstract: Solving combinatorial optimization problems of the kind that can be codified by quadratic unconstrained binary optimization (QUBO) is a promising application of quantum computation. Some problems of this class suitable for practical applications such as the traveling salesman problem (TSP), the bin packing problem (BPP), or the knapsack problem (KP) have inequality constraints that require a particular cost function encoding. The common approach is the use of slack variables to represent the inequality constraints in the cost function. However, the use of slack variables considerably increases the number of qubits and operations required to solve these problems using quantum devices. In this work, we present an alternative method that does not require extra slack variables and consists of using an unbalanced penalization function to represent the inequality constraints in the QUBO. This function is characterized by larger penalization when the inequality constraint is not achieved than when it is. We evaluate our approach on the TSP, BPP, and KP, successfully encoding the optimal solution of the original optimization problem near the ground state cost Hamiltonian. Additionally, we employ D-Wave Advantage and D-Wave hybrid solvers to solve the BPP, surpassing the performance of the slack variables approach by achieving solutions for up to 29 items, whereas the slack variables approach only handles up to 11 items. This new approach can be used to solve combinatorial problems with inequality constraints with a reduced number of resources compared to the slack variables approach using quantum annealing or variational quantum algorithms.


title: Confidence Interval Construction for Multivariate time series using Long Short Term Memory Network

abstract: In this paper we propose a novel procedure to construct a confidence interval for multivariate time series predictions using long short term memory network. The construction uses a few novel block bootstrap techniques. We also propose an innovative block length selection procedure for each of these schemes. Two novel benchmarks help us to compare the construction of this confidence intervals by different bootstrap techniques. We illustrate the whole construction through S\&P $500$ and Dow Jones Index datasets.


title: Towards Good Practices for Missing Modality Robust Action Recognition

abstract: Standard multi-modal models assume the use of the same modalities in training and inference stages. However, in practice, the environment in which multi-modal models operate may not satisfy such assumption. As such, their performances degrade drastically if any modality is missing in the inference stage. We ask: how can we train a model that is robust to missing modalities? This paper seeks a set of good practices for multi-modal action recognition, with a particular interest in circumstances where some modalities are not available at an inference time. First, we study how to effectively regularize the model during training (e.g., data augmentation). Second, we investigate on fusion methods for robustness to missing modalities: we find that transformer-based fusion shows better robustness for missing modality than summation or concatenation. Third, we propose a simple modular network, ActionMAE, which learns missing modality predictive coding by randomly dropping modality features and tries to reconstruct them with the remaining modality features. Coupling these good practices, we build a model that is not only effective in multi-modal action recognition but also robust to modality missing. Our model achieves the state-of-the-arts on multiple benchmarks and maintains competitive performances even in missing modality scenarios. Codes are available at https://github.com/sangminwoo/ActionMAE.


title: The Russian Option with A Random Time Horizon

abstract: This paper is intended to provide a unique valuation formula for the Russian option with a random time horizon; in particular, such option restricts its holders to make their stopping rules before the last exit time of the price of the underlying asset at its running maximum. By the theory of enlargement of filtrations associated with random times, this pricing problem can be transformed into an equivalent optimal stopping problem with a semi-continuous, time-dependent gain function whose partial derivative is singular at certain point. Despite these unpleasant features of the gain function, with our choice of the parameters, we establish the monotonicity of the free boundary and the regularity of the value function, which in turn lead us to the desired free-boundary problem. After this, the nonlinear integral equations that characterise the free boundary and the value function are derived. We also examine the solutions to these equations in details.


title: The American Put Option with A Random Time Horizon

abstract: This paper is intended to provide a unique valuation formula for the American put option in a random time horizon; more precisely, such option restricts any stopping rules to be made before the last exit time of the price of the underlying assets at any fixed level. By exploiting the theory of enlargement of filtrations associated with random times, this pricing problem can be transformed into an equivalent optimal stopping problem with a semi-continuous, time-dependent gain function whose partial derivative is singular at certain point. The difficulties in establishing the monotonicity of the optimal stopping boundary and the regularity of the value function lie essentially in these somewhat unpleasant features of the gain function. However, it turns out that a successful analysis of the continuation and stopping sets with proper assumption can help us overcome these difficulties and obtain the important properties that possessed by the free-boundary, which eventually leads us to the desired free-boundary problem. After this, the nonlinear integral equations that characterise the free-boundary and the value function can be derived. The solution to these equations are examined in details.


title: Mutual Guidance and Residual Integration for Image Enhancement

abstract: Previous studies show the necessity of global and local adjustment for image enhancement. However, existing convolutional neural networks (CNNs) and transformer-based models face great challenges in balancing the computational efficiency and effectiveness of global-local information usage. Especially, existing methods typically adopt the global-to-local fusion mode, ignoring the importance of bidirectional interactions. To address those issues, we propose a novel mutual guidance network (MGN) to perform effective bidirectional global-local information exchange while keeping a compact architecture. In our design, we adopt a two-branch framework where one branch focuses more on modeling global relations while the other is committed to processing local information. Then, we develop an efficient attention-based mutual guidance approach throughout our framework for bidirectional global-local interactions. As a result, both the global and local branches can enjoy the merits of mutual information aggregation. Besides, to further refine the results produced by our MGN, we propose a novel residual integration scheme following the divide-and-conquer philosophy. The extensive experiments demonstrate the effectiveness of our proposed method, which achieves state-of-the-art performance on several public image enhancement benchmarks.


title: Secure Power Control for Downlink Cell-Free Massive MIMO With Passive Eavesdroppers

abstract: This work studies secure communications for a cell-free massive multiple-input multiple-output (CF-mMIMO) network which is attacked by multiple passive eavesdroppers overhearing communications between access points (APs) and users in the network. It will be revealed that the distributed APs in CF-mMIMO allows not only legitimate users but also eavesdroppers to reap the diversity gain, which seriously degrades secrecy performance. Motivated by this, this work proposes an artificial noise (AN)-aided secure power control scheme for CF-mMIMO under passive eavesdropping aiming to achieve a higher secrecy rate and/or guarantee security. In particular, it will be demonstrated that a careful use of AN signal in the power control is especially important to improve the secrecy performance. The performance of the proposed power control scheme is evaluated and compared with various power control schemes via numerical experiments, which clearly shows that the proposed power control scheme outperforms all the competing schemes.


title: On the conical zeta values and the Dedekind zeta values for totally real fields

abstract: The conical zeta values are a generalization of the multiple zeta values which are defined by certain multiple sums over convex cones. In this paper, we present a relation between the values of the Dedekind zeta functions for totally real fields and the conical zeta values for certain algebraic cones. More precisely, we show that the values of the partial zeta functions for totally real fields can be expressed as a rational linear combination of the conical zeta values associated with certain algebraic cones up to the square root of the discriminant.


title: Combining Constructive and Perturbative Deep Learning Algorithms for the Capacitated Vehicle Routing Problem

abstract: The Capacitated Vehicle Routing Problem is a well-known NP-hard problem that poses the challenge of finding the optimal route of a vehicle delivering products to multiple locations. Recently, new efforts have emerged to create constructive and perturbative heuristics to tackle this problem using Deep Learning. In this paper, we join these efforts to develop the Combined Deep Constructor and Perturbator, which combines two powerful constructive and perturbative Deep Learning-based heuristics, using attention mechanisms at their core. Furthermore, we improve the Attention Model-Dynamic for the Capacitated Vehicle Routing Problem by proposing a memory-efficient algorithm that reduces its memory complexity by a factor of the number of nodes. Our method shows promising results. It demonstrates a cost improvement in common datasets when compared against other multiple Deep Learning methods. It also obtains close results to the state-of-the art heuristics from the Operations Research field. Additionally, the proposed memory efficient algorithm for the Attention Model-Dynamic model enables its use in problem instances with more than 100 nodes.


title: Gel-Sol Transition of Thermoresponsive Poly(vinyl alcohol) Solution: Validation of the Universal Critical Scaling Relations

abstract: While undergoing gelation transition, a material passes through a distinctive state called the critical gel state. In the neighborhood of this critical gel state, how viscosity, equilibrium modulus, and relaxation times evolve are correlated by scaling relations, and their universality has been validated for materials undergoing the sol to gel transition. In this work, we extend this approach for the gel to sol transition of a thermoresponsive polymeric system of aqueous Poly(vinyl alcohol) (PVOH) gel that passes through the critical state upon increasing temperature. We observe that, in the neighborhood of the critical gel state, the equilibrium modulus and viscosity demonstrate a power law dependence on the relative distance from the critical state in terms of normalized temperature. Furthermore, the relaxation times in the gel and the sol state shows symmetric power law divergence near the critical state. The corresponding critical power law exponents and the dynamic critical exponents computed at the critical gel to sol transition state validate the scaling and hyperscaling relations originally proposed for the critical sol to gel transition very well. Remarkably, the dependence of complex viscosity on frequency at different temperatures shows a comprehensive mastercurve irrespective of the temperature ramp rate independently in the gel and the sol state. This observation demonstrates how the shape of relaxation time spectrum is independent of both the temperature as well as the ramp rate. Since sol to gel as well as the gel to sol transitions are opposite to each other, the applicability of the scaling relations validated in this work suggests broader symmetry associated with how the structure evolves around the critical state irrespective of the direction.


title: Riesz transforms on $ax+b$ groups

abstract: We prove the $L^p$-boundedness for all $p \in (1,\infty)$ of the first-order Riesz transforms $X_j \mathcal{L}^{-1/2}$ associated with the Laplacian $\mathcal{L} = -\sum_{j=0}^n X_j^2$ on the $ax+b$-group $G = \mathbb{R}^n \rtimes \mathbb{R}$; here $X_0$ and $X_1,\dots,X_n$ are left-invariant vector fields on $G$ in the directions of the factors $\mathbb{R}$ and $\mathbb{R}^n$ respectively. This settles a question left open in previous work of Hebisch and Steger (who proved the result for $p \leq 2$) and of Gaudry and Sj\"ogren (who only considered $n=1=j$). The main novelty here is that we can treat the case $p \in (2,\infty)$ and include the Riesz transform in the direction of $\mathbb{R}$; an operator-valued Fourier multiplier theorem on $\mathbb{R}^n$ turns out to be key to this purpose. We also establish a weak type $(1,1)$ endpoint for the adjoint Riesz transforms in the direction of $\mathbb{R}^n$. By transference, our results imply the $L^p$-boundedness for $p \in (1,\infty)$ of the first-order Riesz transforms associated with the Schr\"odinger operator $-\partial_s^2 + e^{2s}$ on the real line.


title: On DNA Codes Over the Non-Chain Ring $\mathbb{Z}_4+u\mathbb{Z}_4+u^2\mathbb{Z}_4$ with $u^3=1$

abstract: In this paper, we present a novel design strategy of DNA codes with length $3n$ over the non-chain ring $R=\mathbb{Z}_4+u\mathbb{Z}_4+u^2\mathbb{Z}_4$ with $64$ elements and $u^3=1$, where $n$ denotes the length of a code over $R$. We first study and analyze a distance conserving map defined over the ring $R$ into the length-$3$ DNA sequences. Then, we derive some conditions on the generator matrix of a linear code over $R$, which leads to a DNA code with reversible, reversible-complement, homopolymer $2$-run-length, and $\frac{w}{3n}$-GC-content constraints for integer $w$ ($0\leq w\leq 3n$). Finally, we propose a new construction of DNA codes using Reed-Muller type generator matrices. This allows us to obtain DNA codes with reversible, reversible-complement, homopolymer $2$-run-length, and $\frac{2}{3}$-GC-content constraints.


title: Generative Modeling in Sinogram Domain for Sparse-view CT Reconstruction

abstract: The radiation dose in computed tomography (CT) examinations is harmful for patients but can be significantly reduced by intuitively decreasing the number of projection views. Reducing projection views usually leads to severe aliasing artifacts in reconstructed images. Previous deep learning (DL) techniques with sparse-view data require sparse-view/full-view CT image pairs to train the network with supervised manners. When the number of projection view changes, the DL network should be retrained with updated sparse-view/full-view CT image pairs. To relieve this limitation, we present a fully unsupervised score-based generative model in sinogram domain for sparse-view CT reconstruction. Specifically, we first train a score-based generative model on full-view sinogram data and use multi-channel strategy to form highdimensional tensor as the network input to capture their prior distribution. Then, at the inference stage, the stochastic differential equation (SDE) solver and data-consistency step were performed iteratively to achieve fullview projection. Filtered back-projection (FBP) algorithm was used to achieve the final image reconstruction. Qualitative and quantitative studies were implemented to evaluate the presented method with several CT data. Experimental results demonstrated that our method achieved comparable or better performance than the supervised learning counterparts.


title: Lateral beam shifts and depolarization upon oblique reflection from dielectric mirrors

abstract: Dielectric mirrors comprising thin-film multilayers are widely used in optical experiments because they can achieve substantially higher reflectance compared to metal mirrors. Here we investigate potential problems that can arise when dielectric mirrors are used at oblique incidence, in particular for focused beams. We found that light beams reflected from dielectric mirrors can experience lateral beam shifts, beam-shape distortion, and depolarization, and these effects have a strong dependence on wavelength, incident angle, and incident polarization. Because vendors of dielectric mirrors typically do not share the particular layer structure of their products, we designed and simulated several dielectric-mirror stacks, and then also measured the lateral beam shift from two commercial dielectric mirrors and one coated metal mirror. We hope that this paper brings awareness of the tradeoffs between dielectric mirrors and front-surface metal mirrors in certain optics experiments, and suggest that vendors of dielectric mirrors provide information about beam shifts, distortion, and depolarization when their products are used at oblique incidence.


title: UperFormer: A Multi-scale Transformer-based Decoder for Semantic Segmentation

abstract: While a large number of recent works on semantic segmentation focus on designing and incorporating a transformer-based encoder, much less attention and vigor have been devoted to transformer-based decoders. For such a task whose hallmark quest is pixel-accurate prediction, we argue that the decoder stage is just as crucial as that of the encoder in achieving superior segmentation performance, by disentangling and refining the high-level cues and working out object boundaries with pixel-level precision. In this paper, we propose a novel transformer-based decoder called UperFormer, which is plug-and-play for hierarchical encoders and attains high quality segmentation results regardless of encoder architecture. UperFormer is equipped with carefully designed multi-head skip attention units and novel upsampling operations. Multi-head skip attention is able to fuse multi-scale features from backbones with those in decoders. The upsampling operation, which incorporates feature from encoder, can be more friendly for object localization. It brings a 0.4% to 3.2% increase compared with traditional upsampling methods. By combining UperFormer with Swin Transformer (Swin-T), a fully transformer-based symmetric network is formed for semantic segmentation tasks. Extensive experiments show that our proposed approach is highly effective and computationally efficient. On Cityscapes dataset, we achieve state-of-the-art performance. On the more challenging ADE20K dataset, our best model yields a single-scale mIoU of 50.18, and a multi-scale mIoU of 51.8, which is on-par with the current state-of-art model, while we drastically cut the number of FLOPs by 53.5%. Our source code and models are publicly available at: https://github.com/shiwt03/UperFormer


title: XKD: Cross-modal Knowledge Distillation with Domain Alignment for Video Representation Learning

abstract: We present XKD, a novel self-supervised framework to learn meaningful representations from unlabelled videos. XKD is trained with two pseudo objectives. First, masked data reconstruction is performed to learn modality-specific representations from audio and visual streams. Next, self-supervised cross-modal knowledge distillation is performed between the two modalities through a teacher-student setup to learn complementary information. We introduce a novel domain alignment strategy to tackle domain discrepancy between audio and visual modalities enabling effective cross-modal knowledge distillation. Additionally, to develop a general-purpose network capable of handling both audio and visual streams, modality-agnostic variants of XKD are introduced, which use the same pretrained backbone for different audio and visual tasks. Our proposed cross-modal knowledge distillation improves video action classification by $8\%$ to $14\%$ on UCF101, HMDB51, and Kinetics400. Additionally, XKD improves multimodal action classification by $5.5\%$ on Kinetics-Sound. XKD shows state-of-the-art performance in sound classification on ESC50, achieving top-1 accuracy of $96.5\%$.


title: TRAC: A Textual Benchmark for Reasoning about Actions and Change

abstract: Reasoning about actions and change (RAC) is essential to understand and interact with the ever-changing environment. Previous AI research has shown the importance of fundamental and indispensable knowledge of actions, i.e., preconditions and effects. However, traditional methods rely on logical formalization which hinders practical applications. With recent transformer-based language models (LMs), reasoning over text is desirable and seemingly feasible, leading to the question of whether LMs can effectively and efficiently learn to solve RAC problems. We propose four essential RAC tasks as a comprehensive textual benchmark and generate problems in a way that minimizes the influence of other linguistic requirements (e.g., grounding) to focus on RAC. The resulting benchmark, TRAC, encompassing problems of various complexities, facilitates a more granular evaluation of LMs, precisely targeting the structural generalization ability much needed for RAC. Experiments with three high-performing transformers indicates that additional efforts are needed to tackle challenges raised by TRAC.


title: Transitivity on subclasses of chordal graphs

abstract: Let $G=(V, E)$ be a graph, where $V$ and $E$ are the vertex and edge sets, respectively. For two disjoint subsets $A$ and $B$ of $V$, we say $A$ \textit{dominates} $B$ if every vertex of $B$ is adjacent to at least one vertex of $A$ in $G$. A vertex partition $\pi = \{V_1, V_2, \ldots, V_k\}$ of $G$ is called a \emph{transitive $k$-partition} if $V_i$ dominates $V_j$ for all $i,j$, where $1\leq i<j\leq k$. The maximum integer $k$ for which the above partition exists is called \emph{transitivity} of $G$ and it is denoted by $Tr(G)$. The \textsc{Maximum Transitivity Problem} is to find a transitive partition of a given graph with the maximum number of partitions. It was known that the decision version of \textsc{Maximum Transitivity Problem} is NP-complete for chordal graphs [Iterated colorings of graphs, \emph{Discrete Mathematics}, 278, 2004]. In this paper, we first prove that this problem can be solved in linear time for \emph{split graphs} and for the \emph{complement of bipartite chain graphs}, two subclasses of chordal graphs. We also discuss Nordhaus-Gaddum type relations for transitivity and provide counterexamples for an open problem posed by J. T. Hedetniemi and S. T. Hedetniemi [The transitivity of a graph, \emph{J. Combin. Math. Combin. Comput}, 104, 2018]. Finally, we characterize transitively critical graphs having fixed transitivity.


title: Logarithmic Duality of the Curvature Perturbation

abstract: We study the comoving curvature perturbation $\mathcal{R}$ in the single-field inflation models whose potential can be approximated by a piecewise quadratic potential $V(\varphi)$ by using the $\delta N$ formalism. We find a general formula for $\mathcal{R}(\delta\varphi, \delta\pi)$, consisting of a sum of logarithmic functions of the field perturbation $\delta\varphi$ and the velocity perturbation $\delta\pi$ at the point of interest, as well as of $\delta\pi_*$ at the boundaries of each quadratic piece, which are functions of ($\delta\varphi, \delta\pi$) through the equation of motion. Each logarithmic expression has an equivalent dual expression, due to the second-order nature of the equation of motion for $\varphi$. We also clarify the condition under which $\mathcal{R}(\delta\varphi, \delta\pi)$ reduces to a single logarithm, which yields either the renowned ``exponential tail'' of the probability distribution function of $\mathcal{R}$ or a Gumbel-distribution-like tail.


title: Enhanced Tracking and Beamforming Codebook Design for Wideband Terahertz Massive MIMO System

abstract: True-time-delay (TTD) lines are recently applied inside Terahertz (THz) hybrid-precoding transceiver to acquire high beamforming gain against beam squint effect. However, beam tracking turns into a challenging puzzle where enormous potential beam directions bring about unacceptable overhead consumption. Frequency-scanning-based beam tracking is initially explored but still imperfect in previous studies. In this paper, based on TTD-aided hybrid precoding structure, we give an enhanced frequency-scanning-based tracking scheme. Multiple beams are generated and utilized simultaneously via several subcarriers for tracking at one timeslot. The squint beams' angular coverage at all subcarriers can be flexibly controlled by two different subcarrier-angular mapping policies, named forward-pairing and backward-pairing. Then multiple physical directions can be simultaneously searched in one timeslot for lower overhead consumption. Besides, closed-form searching radius bound, parameter configuration and interferences are theoretically analyzed. Furthermore, we provide the coupled codebook design for TTDs and phase shifters (PSs), with joint consideration of both beamforming and tracking. Analytical and numerical results demonstrate the superiority of the new frequency-scanning-based tracking scheme and beamforming codebook.


title: Spectral Invariance of Quasi-Banach Algebras for Matrices and Pseudodifferential Operators

abstract: In the paper we extend the spectral invariance of pseudodifferential operators acting on (non-weighted) classical modulation spaces to allow the Lebesgue exponents to be smaller than one. These spaces occur naturally in approximation theory and data compression problems.


title: LU decomposition and Toeplitz decomposition of a neural network

abstract: It is well-known that any matrix $A$ has an LU decomposition. Less well-known is the fact that it has a 'Toeplitz decomposition' $A = T_1 T_2 \cdots T_r$ where $T_i$'s are Toeplitz matrices. We will prove that any continuous function $f : \mathbb{R}^n \to \mathbb{R}^m$ has an approximation to arbitrary accuracy by a neural network that takes the form $L_1 \sigma_1 U_1 \sigma_2 L_2 \sigma_3 U_2 \cdots L_r \sigma_{2r-1} U_r$, i.e., where the weight matrices alternate between lower and upper triangular matrices, $\sigma_i(x) := \sigma(x - b_i)$ for some bias vector $b_i$, and the activation $\sigma$ may be chosen to be essentially any uniformly continuous nonpolynomial function. The same result also holds with Toeplitz matrices, i.e., $f \approx T_1 \sigma_1 T_2 \sigma_2 \cdots \sigma_{r-1} T_r$ to arbitrary accuracy, and likewise for Hankel matrices. A consequence of our Toeplitz result is a fixed-width universal approximation theorem for convolutional neural networks, which so far have only arbitrary width versions. Since our results apply in particular to the case when $f$ is a general neural network, we may regard them as LU and Toeplitz decompositions of a neural network. The practical implication of our results is that one may vastly reduce the number of weight parameters in a neural network without sacrificing its power of universal approximation. We will present several experiments on real data sets to show that imposing such structures on the weight matrices sharply reduces the number of training parameters with almost no noticeable effect on test accuracy.


title: ALICE in Public Outreach and Bricks

abstract: In the last two years various existing public outreach activities in ALICE have been adapted for online usage, this includes the well established particle physics masterclasses but also virtual visits to ALICE. Based on these foundations a six month online workshop was carried out in 2021 with the goal to design a LEGO model of the ALICE detector at the LHC at the scale of a typical minifigure (ca. 1:40) and to motivate young people for a long term online collaboration in a particle physics project. The design stage of the model took half a year with regular online design sessions accompanied by input on 3D construction, detector technology, the physics questions of ALICE, virtual ALICE visits, and particle physics masterclasses. This stage provided first-hand experience on the dynamics of working on different sub-projects in a research collaboration and resulted in a model with more than 16 000 parts that was assembled by the participants during one weekend in an in-person workshop. The experience gained during this construction has been used further by the young designers to optimise the model over the period of another year.


title: Operator Splitting Value Iteration

abstract: We introduce new planning and reinforcement learning algorithms for discounted MDPs that utilize an approximate model of the environment to accelerate the convergence of the value function. Inspired by the splitting approach in numerical linear algebra, we introduce Operator Splitting Value Iteration (OS-VI) for both Policy Evaluation and Control problems. OS-VI achieves a much faster convergence rate when the model is accurate enough. We also introduce a sample-based version of the algorithm called OS-Dyna. Unlike the traditional Dyna architecture, OS-Dyna still converges to the correct value function in presence of model approximation error.

categories: cs.LG cs.AI cs.SY eess.SY math.OC stat.ML


title: Predicting Tourism Demand in Indonesia Using Google Trends Data

abstract: Tourism data is one of the strategic data in Indonesia. In addition, tourism is one of the ten priority programs of national development planning in Indonesia. BPS-Statistics Indonesia has collected data related to tourism demand in Indonesia, but these data have different time period. Several data can be provided monthly, while the other data can be provided annually. However, accurate and real time tourism data are needed for effective policy making. In this era, all of information about tourism destination or accommodation can be gotten easily through internet, especially information from Google search engine, such as information about tourism places, flights, hotels, and ticket for tourism attractions. Since 2004, Google has provided the information of user behavior through Google Trends tool. This paper aims to analyze and compare the patterns of tourism demand in Indonesia from Google Trends data with tourism statistics from BPS-Statistics Indonesia. In order to understand tourism demand in Indonesia, we used Google Trends data on a set of queries related to tourism. This paper shows that the search intensity of related queries provides the pattern of predicted tourism demand in Indonesia. We evaluated the prediction result by comparing several time series models. Furthermore, we compared and correlated the Google Trends data with official data. The result shows that Google Trends data and tourism statistics have similar pattern when there were disasters. The result also shows that Google Trends data has correlation with official data and produced accurate prediction of tourism demand in Indonesia. Therefore, Google Trends data can be used to predict and understand the pattern of tourism demand in Indonesia.


title: Efficient Incremental Text-to-Speech on GPUs

abstract: Incremental text-to-speech, also known as streaming TTS, has been increasingly applied to online speech applications that require ultra-low response latency to provide an optimal user experience. However, most of the existing speech synthesis pipelines deployed on GPU are still non-incremental, which uncovers limitations in high-concurrency scenarios, especially when the pipeline is built with end-to-end neural network models. To address this issue, we present a highly efficient approach to perform real-time incremental TTS on GPUs with Instant Request Pooling and Module-wise Dynamic Batching. Experimental results demonstrate that the proposed method is capable of producing high-quality speech with a first-chunk latency lower than 80ms under 100 QPS on a single NVIDIA A10 GPU and significantly outperforms the non-incremental twin in both concurrency and latency. Our work reveals the effectiveness of high-performance incremental TTS on GPUs.


title: Spatial-Temporal Attention Network for Open-Set Fine-Grained Image Recognition

abstract: Triggered by the success of transformers in various visual tasks, the spatial self-attention mechanism has recently attracted more and more attention in the computer vision community. However, we empirically found that a typical vision transformer with the spatial self-attention mechanism could not learn accurate attention maps for distinguishing different categories of fine-grained images. To address this problem, motivated by the temporal attention mechanism in brains, we propose a spatial-temporal attention network for learning fine-grained feature representations, called STAN, where the features learnt by implementing a sequence of spatial self-attention operations corresponding to multiple moments are aggregated progressively. The proposed STAN consists of four modules: a self-attention backbone module for learning a sequence of features with self-attention operations, a spatial feature self-organizing module for facilitating the model training, a spatial-temporal feature learning module for aggregating the re-organized features via a Long Short-Term Memory network, and a context-aware module that is implemented as the forget block of the spatial-temporal feature learning module for preserving/forgetting the long-term memory by utilizing contextual information. Then, we propose a STAN-based method for open-set fine-grained recognition by integrating the proposed STAN network with a linear classifier, called STAN-OSFGR. Extensive experimental results on 3 fine-grained datasets and 2 coarse-grained datasets demonstrate that the proposed STAN-OSFGR outperforms 9 state-of-the-art open-set recognition methods significantly in most cases.


title: Combinatorial Civic Crowdfunding with Budgeted Agents: Welfare Optimality at Equilibrium and Optimal Deviation

abstract: Civic Crowdfunding (CC) uses the ``power of the crowd'' to garner contributions towards public projects. As these projects are non-excludable, agents may prefer to ``free-ride,'' resulting in the project not being funded. For single project CC, researchers propose to provide refunds to incentivize agents to contribute, thereby guaranteeing the project's funding. These funding guarantees are applicable only when agents have an unlimited budget. This work focuses on a combinatorial setting, where multiple projects are available for CC and agents have a limited budget. We study certain specific conditions where funding can be guaranteed. Further, funding the optimal social welfare subset of projects is desirable when every available project cannot be funded due to budget restrictions. We prove the impossibility of achieving optimal welfare at equilibrium for any monotone refund scheme. We then study different heuristics that the agents can use to contribute to the projects in practice. Through simulations, we demonstrate the heuristics' performance as the average-case trade-off between welfare obtained and agent utility.


title: Affine Transformation Edited and Refined Deep Neural Network for Quantitative Susceptibility Mapping

abstract: Deep neural networks have demonstrated great potential in solving dipole inversion for Quantitative Susceptibility Mapping (QSM). However, the performances of most existing deep learning methods drastically degrade with mismatched sequence parameters such as acquisition orientation and spatial resolution. We propose an end-to-end AFfine Transformation Edited and Refined (AFTER) deep neural network for QSM, which is robust against arbitrary acquisition orientation and spatial resolution up to 0.6 mm isotropic at the finest. The AFTER-QSM neural network starts with a forward affine transformation layer, followed by an Unet for dipole inversion, then an inverse affine transformation layer, followed by a Residual Dense Network (RDN) for QSM refinement. Simulation and in-vivo experiments demonstrated that the proposed AFTER-QSM network architecture had excellent generalizability. It can successfully reconstruct susceptibility maps from highly oblique and anisotropic scans, leading to the best image quality assessments in simulation tests and suppressed streaking artifacts and noise levels for in-vivo experiments compared with other methods. Furthermore, ablation studies showed that the RDN refinement network significantly reduced image blurring and susceptibility underestimation due to affine transformations. In addition, the AFTER-QSM network substantially shortened the reconstruction time from minutes using conventional methods to only a few seconds.


title: Simple bots breed social punishment in humans

abstract: Costly punishment has been suggested as a key mechanism for stabilizing cooperation in one-shot games. However, recent studies have revealed that the effectiveness of costly punishment can be diminished by second-order free riders (i.e., cooperators who never punish defectors) and antisocial punishers (i.e., defectors who punish cooperators). In a two-stage prisoner's dilemma game, players not only need to choose between cooperation and defection in the first stage, but also need to decide whether to punish their opponent in the second stage. Here, we extend the theory of punishment in one-shot games by introducing simple bots, who consistently choose prosocial punishment and do not change their actions over time. We find that this simple extension of the game allows prosocial punishment to dominate in well-mixed and networked populations, and that the minimum fraction of bots required for the dominance of prosocial punishment monotonically increases with increasing dilemma strength. Furthermore, if humans possess a learning bias toward a "copy the majority" rule or if bots are present at higher degree nodes in scale-free networks, the fully dominance of prosocial punishment is still possible at a high dilemma strength. These results indicate that introducing bots can be a significant factor in establishing prosocial punishment. We therefore, provide a novel explanation for the evolution of prosocial punishment, and note that the contrasting results that emerge from the introduction of different types of bots also imply that the design of the bots matters.


title: DMIS: Dynamic Mesh-based Importance Sampling for Training Physics-Informed Neural Networks

abstract: Modeling dynamics in the form of partial differential equations (PDEs) is an effectual way to understand real-world physics processes. For complex physics systems, analytical solutions are not available and numerical solutions are widely-used. However, traditional numerical algorithms are computationally expensive and challenging in handling multiphysics systems. Recently, using neural networks to solve PDEs has made significant progress, called physics-informed neural networks (PINNs). PINNs encode physical laws into neural networks and learn the continuous solutions of PDEs. For the training of PINNs, existing methods suffer from the problems of inefficiency and unstable convergence, since the PDE residuals require calculating automatic differentiation. In this paper, we propose Dynamic Mesh-based Importance Sampling (DMIS) to tackle these problems. DMIS is a novel sampling scheme based on importance sampling, which constructs a dynamic triangular mesh to estimate sample weights efficiently. DMIS has broad applicability and can be easily integrated into existing methods. The evaluation of DMIS on three widely-used benchmarks shows that DMIS improves the convergence speed and accuracy in the meantime. Especially in solving the highly nonlinear Schr\"odinger Equation, compared with state-of-the-art methods, DMIS shows up to 46% smaller root mean square error and five times faster convergence speed. Code are available at https://github.com/MatrixBrain/DMIS.


title: The $\gamma$-support as a micro-support

abstract: We prove that for any element $L$ in the completion of the space of smooth compact exact Lagrangian submanifolds of a cotangent bundle equipped with the spectral distance, the $\gamma$-support of $L$ coincides with the reduced micro-support of its sheaf quantization. As an application, we give a characterization of the Vichery subdifferential in terms of $\gamma$-support.


title: SOS Polynomials and Matrix Representations of Rational Real Functions

abstract: The characteristic properties of Artin's denominators in Hilbert's 17th problem are obtained. It is proved that numerators of partial derivative of rational real function from the Nevanlinna class are SOS polynomials.


title: Uniaxial negative thermal expansion in an orthorhombic superconductor CoZr3

abstract: We investigated the temperature evolution of crystal structure of orthorhombic CoZr3, which is a superconductor with a transition temperature of 4.3 K, by synchrotron and laboratory (CuK{\alpha}) X-ray diffraction. Uniaxial negative thermal expansion along the c-axis, which is similar to that observed in tetragonal CoZr2, has been observed at a wide temperature range of T = 90-800 K in CoZr3, while a-and b-axis exhibit positive thermal expansion.


title: Wave breaking on the surface of a dielectric liquid in a horizontal electric field

abstract: The weakly nonlinear dynamics of the free surface of a dielectric liquid in an electric field directed tangentially to the unperturbed boundary is investigated numerically. Within the framework of the strong field model, when the effects of capillarity and gravity are not taken into account, it is shown that nonlinear surface waves have a tendency to break. In result of the collapse of the surface waves, the curvature of the boundary and the gradient of the local electric field undergo infinite discontinuity on the surface of the liquid. The angles of the boundary inclination remain small. The characteristic collapse time of a surface wave traveling in a given direction is calculated versus the dielectric constant of the liquid. It is shown that the time of the singularity formation increases infinitely at small and high values of the dielectric constant. The first case corresponds to the transition of the system to the neutral stability regime (the jump in electrostatic pressure at the boundary turns into zero). At high values of the dielectric constant of the liquid, the collapse time also increases. This effect is associated with the realization of a special regime of fluid motion, in which the propagation of nonlinear surface waves of an arbitrary configuration occurs without distortions. For the liquids with relative permittivity close to five, the wave breaking time reaches a minimum, i.e., the collapse of the surface waves for such liquids occurs most intensively.


title: Hidden-flavor pentaquarks

abstract: We have recently studied hidden-charm pentaquarks, $c\bar c qqq$, using dynamical correlations between the heavy quarks arising from the Coulomb-like nature of the short-range interaction. A pattern was obtained that compares well with the experimental data. We extend our description to other flavor sectors which can be framed within the same type of structures discussed in the original paper. A detailed comparison is made with other results in the literature and with experimental data. Predictions will be a useful tool to discriminate between different models of multiquark system dynamics.


title: Threshold of Primordial Black Hole Formation against Velocity Dispersion in Matter-Dominated Era

abstract: We study the effects of velocity dispersion on the formation of primordial black holes~(PBHs) in a matter-dominated era. The velocity dispersion is generated through the nonlinear growth of perturbations and has the potential to impede the gravitational collapse and thereby the formation of PBHs. To make discussions clear, we consider two distinct length scales. The larger one is where gravitational collapse occurs which could lead to PBH formation, and the smaller one is where the velocity dispersion develops due to nonlinear interactions. We estimate the effect of the velocity dispersion on the PBH formation by comparing the free-fall timescale and the timescale for a particle to cross the collapsing region. As a demonstration, we consider a log-normal power spectrum for the initial density perturbation with the peak value $\sigma_0^2$ at a scale that corresponds to the larger scale. We find that the threshold value of the density perturbation $\tilde \delta_{\rm th}$ at the horizon entry for the PBH formation scales as $\tilde \delta_{\rm th}\propto \sigma_0^{2/5}$ for $\sigma_0\ll1$.


title: On picking sequences for chores

abstract: We consider the problem of allocating $m$ indivisible chores to $n$ agents with additive disvaluation (cost) functions. It is easy to show that there are picking sequences that give every agent (that uses the greedy picking strategy) a bundle of chores of disvalue at most twice her share value (maximin share, MMS, for agents of equal entitlement, and anyprice share, APS, for agents of arbitrary entitlement). Aziz, Li and Wu (2022) designed picking sequences that improve this ratio to $\frac{5}{3}$ for the case of equal entitlement. We design picking sequences that improve the ratio to~1.733 for the case of arbitrary entitlement, and to $\frac{8}{5}$ for the case of equal entitlement. (In fact, computer assisted analysis suggests that the ratio is smaller than $1.543$ in the equal entitlement case.) We also prove a lower bound of $\frac{3}{2}$ on the obtainable ratio when $n$ is sufficiently large. Additional contributions of our work include improved guarantees in the equal entitlement case when $n$ is small; introduction of the chore share as a convenient proxy to other share notions for chores; introduction of ex-ante notions of envy for risk averse agents; enhancements to our picking sequences that eliminate such envy; showing that a known allocation algorithm (not based on picking sequences) for the equal entitlement case gives each agent a bundle of disvalue at most $\frac{4n-1}{3n}$ times her APS (previously, this ratio was shown for this algorithm with respect to the easier benchmark of the MMS).


title: On the Re-Solving Heuristic for (Binary) Contextual Bandits with Knapsacks

abstract: In the problem of (binary) contextual bandits with knapsacks (CBwK), the agent receives an i.i.d. context in each of the $T$ rounds and chooses an action, resulting in a random reward and a random consumption of resources that are related to an i.i.d. external factor. The agent's goal is to maximize the accumulated reward under the initial resource constraints. In this work, we combine the re-solving heuristic, which proved successful in revenue management, with distribution estimation techniques to solve this problem. We consider two different information feedback models, with full and partial information, which vary in the difficulty of getting a sample of the external factor. Under both information feedback settings, we achieve two-way results: (1) For general problems, we show that our algorithm gets an $\widetilde O(T^{\alpha_u} + T^{\alpha_v} + T^{1/2})$ regret against the fluid benchmark. Here, $\alpha_u$ and $\alpha_v$ reflect the complexity of the context and external factor distributions, respectively. This result is comparable to existing results. (2) When the fluid problem is linear programming with a unique and non-degenerate optimal solution, our algorithm leads to an $\widetilde O(1)$ regret. To the best of our knowledge, this is the first $\widetilde O(1)$ regret result in the CBwK problem regardless of information feedback models. We further use numerical experiments to verify our results.


title: High-energy Neutrino Productions from AGN Disk Transients Impacted by Circum-disk Medium

abstract: Various supernovae (SN), compact object coalescences, and tidal disruption events are widely believed to occur embedded in active galactic nuclei (AGN) accretion disks and generate detectable electromagnetic (EM) signals. We collectively refer to them as \emph{AGN disk transients}. The inelastic hadronuclear ($pp$) interactions between shock-accelerated cosmic rays and AGN disk materials shortly after the ejecta shock breaks out of the disk can produce high-energy neutrinos. However, the expected efficiency of neutrino production would decay rapidly by adopting a pure Gaussian density atmosphere profile applicable for stable gas-dominated disks. On the other hand, AGN outflows and disk winds are commonly found around AGN accretion disks. In this paper, we present that the circum-disk medium would further consume the shock kinetic energy to more efficiently produce high-energy neutrinos, especially for $\sim$\,TeV$-$PeV neutrinos that IceCube detects. Thanks to the existence of the circum-disk medium, we find that the neutrino production will be enhanced significantly and make a much higher contribution to the diffuse neutrino background. Optimistically, $\sim20\%$ diffuse neutrino background can be contributed from AGN disk transients.


title: Particle-based Variational Inference with Preconditioned Functional Gradient Flow

abstract: Particle-based variational inference (VI) minimizes the KL divergence between model samples and the target posterior with gradient flow estimates. With the popularity of Stein variational gradient descent (SVGD), the focus of particle-based VI algorithms has been on the properties of functions in Reproducing Kernel Hilbert Space (RKHS) to approximate the gradient flow. However, the requirement of RKHS restricts the function class and algorithmic flexibility. This paper offers a general solution to this problem by introducing a functional regularization term that encompasses the RKHS norm as a special case. This allows us to propose a new particle-based VI algorithm called preconditioned functional gradient flow (PFG). Compared to SVGD, PFG has several advantages. It has a larger function class, improved scalability in large particle-size scenarios, better adaptation to ill-conditioned distributions, and provable continuous-time convergence in KL divergence. Additionally, non-linear function classes such as neural networks can be incorporated to estimate the gradient flow. Our theory and experiments demonstrate the effectiveness of the proposed framework.


title: MPCViT: Searching for Accurate and Efficient MPC-Friendly Vision Transformer with Heterogeneous Attention

abstract: Secure multi-party computation (MPC) enables computation directly on encrypted data and protects both data and model privacy in deep learning inference. However, existing neural network architectures, including Vision Transformers (ViTs), are not designed or optimized for MPC and incur significant latency overhead. We observe Softmax accounts for the major latency bottleneck due to a high communication complexity, but can be selectively replaced or linearized without compromising the model accuracy. Hence, in this paper, we propose an MPC-friendly ViT, dubbed MPCViT, to enable accurate yet efficient ViT inference in MPC. Based on a systematic latency and accuracy evaluation of the Softmax attention and other attention variants, we propose a heterogeneous attention optimization space. We also develop a simple yet effective MPC-aware neural architecture search algorithm for fast Pareto optimization. To further boost the inference efficiency, we propose MPCViT+, to jointly optimize the Softmax attention and other network components, including GeLU, matrix multiplication, etc. With extensive experiments, we demonstrate that MPCViT achieves 1.9%, 1.3% and 3.6% higher accuracy with 6.2x, 2.9x and 1.9x latency reduction compared with baseline ViT, MPCFormer and THE-X on the Tiny-ImageNet dataset, respectively. MPCViT+ further achieves a better Pareto front compared with MPCViT. The code and models for evaluation are available at https://github.com/PKU-SEC-Lab/mpcvit.


title: Learning General Audio Representations with Large-Scale Training of Patchout Audio Transformers

abstract: The success of supervised deep learning methods is largely due to their ability to learn relevant features from raw data. Deep Neural Networks (DNNs) trained on large-scale datasets are capable of capturing a diverse set of features, and learning a representation that can generalize onto unseen tasks and datasets that are from the same domain. Hence, these models can be used as powerful feature extractors, in combination with shallower models as classifiers, for smaller tasks and datasets where the amount of training data is insufficient for learning an end-to-end model from scratch. During the past years, Convolutional Neural Networks (CNNs) have largely been the method of choice for audio processing. However, recently attention-based transformer models have demonstrated great potential in supervised settings, outperforming CNNs. In this work, we investigate the use of audio transformers trained on large-scale datasets to learn general-purpose representations. We study how the different setups in these audio transformers affect the quality of their embeddings. We experiment with the models' time resolution, extracted embedding level, and receptive fields in order to see how they affect performance on a variety of tasks and datasets, following the HEAR 2021 NeurIPS challenge evaluation setup. Our results show that representations extracted by audio transformers outperform CNN representations. Furthermore, we will show that transformers trained on Audioset can be extremely effective representation extractors for a wide range of downstream tasks.


title: Probability Distribution Functions of Sunspot Magnetic Flux

abstract: We have investigated the probability distributions of sunspot area and magnetic flux by using the data from Royal Greenwich Observatory and USAF/NOAA. We have constructed a sample of 2995 regions with maximum-development areas $\ge$ 500 MSH (millionths of solar hemisphere), covering 146.7 years (1874--2020). The data were fitted by a power-law distribution and four two-parameter distributions (tapered power-law, gamma, lognormal, and Weibull distributions). The power-law model was unfavorable compared to the four models in terms of AIC, and was not acceptable by the classical Kolmogorov-Smirnov test. The lognormal and Weibull distributions were excluded because their behavior extended to smaller regions ($S \ll 500$ MSH) do not connect to the previously published results. Therefore, our choices were tapered power-law and gamma distributions. The power-law portion of the tapered power-law and gamma distributions was found to have a power exponent of 1.35--1.9. Due to the exponential fall-off of these distributions, the expected frequencies of large sunspots are low. The largest sunspot group observed had an area of 6132 MSH, and the frequency of sunspots larger than $10^4$ MSH was estimated to be every 3 -- 8 $\times 10^4$ years. We also have estimated the distributions of the Sun-as-a-star total sunspot areas. The largest total area covered by sunspots in the record was 1.67 % of the visible disk, and can be up to 2.7 % by artificially increasing the lifetimes of large sunspots in an area evolution model. These values are still smaller than those found on active Sun-like stars.


title: Microarchitectural Leakage Templates and Their Application to Cache-Based Side Channels

abstract: The complexity of modern processor architectures has given rise to sophisticated interactions among their components. Such interactions may result in potential attack vectors in terms of side channels, possibly available to user-land exploits to leak secret data. Exploitation and countering of such side channels require a detailed understanding of the target component. However, such detailed information is commonly unpublished for many CPUs. In this paper, we introduce the concept of Leakage Templates to abstractly describe specific side channels and identify their occurrences in binary applications. We design and implement Plumber, a framework to derive the generic Leakage Templates from individual code sequences that are known to cause leakage (e.g., found by prior work). Plumber uses a combination of instruction fuzzing, instructions' operand mutation and statistical analysis to explore undocumented behavior of microarchitectural optimizations and derive sufficient conditions on vulnerable code inputs that, if hold can trigger a distinguishing behavior. Using Plumber we identified novel leakage primitives based on Leakage Templates (for ARM Cortex-A53 and -A72 cores), in particular related to previction (a new premature cache eviction), and prefetching behavior. We show the utility of Leakage Templates by re-identifying a prefetcher-based vulnerability in OpenSSL 1.1.0g first reported by Shin et al. [40].


title: Testing Homological Equivalence Using Betti Numbers

abstract: In this article, we propose a one-sample test to check whether the support of the unknown distribution generating the data is homologically equivalent to the support of some specified distribution or not OR using the corresponding two-sample test, one can test whether the supports of two unknown distributions are homologically equivalent or not. In the course of this study, test statistics based on the Betti numbers are formulated, and the consistency of the tests is established under the critical and the supercritical regimes. Moreover, some simulation studies are conducted and results are compared with the existing methodologies such as Robinson's permutation test and test based on mean persistent landscape functions. Furthermore, the practicability of the tests is shown on two well-known real data sets also.


title: The European AI Liability Directives -- Critique of a Half-Hearted Approach and Lessons for the Future

abstract: As ChatGPT et al. conquer the world, the optimal liability framework for AI systems remains an unsolved problem across the globe. In a much-anticipated move, the European Commission advanced two proposals outlining the European approach to AI liability in September 2022: a novel AI Liability Directive and a revision of the Product Liability Directive. They constitute the final cornerstone of EU AI regulation. Crucially, the liability proposals and the EU AI Act are inherently intertwined: the latter does not contain any individual rights of affected persons, and the former lack specific, substantive rules on AI development and deployment. Taken together, these acts may well trigger a Brussels Effect in AI regulation, with significant consequences for the US and beyond. This paper makes three novel contributions. First, it examines in detail the Commission proposals and shows that, while making steps in the right direction, they ultimately represent a half-hearted approach: if enacted as foreseen, AI liability in the EU will primarily rest on disclosure of evidence mechanisms and a set of narrowly defined presumptions concerning fault, defectiveness and causality. Hence, second, the article suggests amendments, which are collected in an Annex at the end of the paper. Third, based on an analysis of the key risks AI poses, the final part of the paper maps out a road for the future of AI liability and regulation, in the EU and beyond. This includes: a comprehensive framework for AI liability; provisions to support innovation; an extension to non-discrimination/algorithmic fairness, as well as explainable AI; and sustainability. I propose to jump-start sustainable AI regulation via sustainability impact assessments in the AI Act and sustainable design defects in the liability regime. In this way, the law may help spur not only fair AI and XAI, but potentially also sustainable AI (SAI).


title: Integer Representations of the Generalized Symmetric Groups

abstract: In this paper, we construct a mixed-base number system over the generalized symmetric group $G(m,1,n)$, which is a complex reflection group with a root system of type $B_n^{(m)}$. We also establish one-to-one correspondence between all positive integers in the set $\{1,\cdots,m^nn!\}$ and the elements of $G(m,1,n)$ by constructing the subexceedant function in relation to this group. In addition, we provide a new enumeration system for $G(m,1,n)$ by defining the inversion statistic on $G(m,1,n)$. Finally, we prove that the \textit{flag-major index} is equi-distributed with this inversion statistic on $G(m,1,n)$. Therefore, the flag-major index is Mahonian on $G(m,1,n)$ with respect to the length function $L$.


title: Video on Demand Streaming Using RL-based Edge Caching in 5G Networks

abstract: Edge caching can significantly improve the 5G networks' performance both in terms of delay and backhaul traffic. We use a reinforcement learning-based (RL-based) caching technique that can adapt to time-location-dependent popularity patterns for on-demand video contents. In a private 5G, we implement the proposed caching scheme as two virtual network functions (VNFs), edge and remote servers, and measure the cache hit ratio as a KPI. Combined with the HLS protocol, the proposed video-on-demand (VoD) streaming is a reliable and scalable service that can adapt to content popularity.


title: Sparse Bayesian mass-mapping using trans-dimensional MCMC

abstract: Uncertainty quantification is a crucial step of cosmological mass-mapping that is often ignored. Suggested methods are typically only approximate or make strong assumptions of Gaussianity of the shear field. Probabilistic sampling methods, such as Markov chain Monte Carlo (MCMC), draw samples form a probability distribution, allowing for full and flexible uncertainty quantification, however these methods are notoriously slow and struggle in the high-dimensional parameter spaces of imaging problems. In this work we use, for the first time, a trans-dimensional MCMC sampler for mass-mapping, promoting sparsity in a wavelet basis. This sampler gradually grows the parameter space as required by the data, exploiting the extremely sparse nature of mass maps in wavelet space. The wavelet coefficients are arranged in a tree-like structure, which adds finer scale detail as the parameter space grows. We demonstrate the trans-dimensional sampler on galaxy cluster-scale images where the planar modelling approximation is valid. In high-resolution experiments, this method produces naturally parsimonious solutions, requiring less than 1% of the potential maximum number of wavelet coefficients and still producing a good fit to the observed data. In the presence of noisy data, trans-dimensional MCMC produces a better reconstruction of mass-maps than the standard smoothed Kaiser-Squires method, with the addition that uncertainties are fully quantified. This opens up the possibility for new mass maps and inferences about the nature of dark matter using the new high-resolution data from upcoming weak lensing surveys such as Euclid.


title: Generating 2D and 3D Master Faces for Dictionary Attacks with a Network-Assisted Latent Space Evolution

abstract: A master face is a face image that passes face-based identity authentication for a high percentage of the population. These faces can be used to impersonate, with a high probability of success, any user, without having access to any user information. We optimize these faces for 2D and 3D face verification models, by using an evolutionary algorithm in the latent embedding space of the StyleGAN face generator. For 2D face verification, multiple evolutionary strategies are compared, and we propose a novel approach that employs a neural network to direct the search toward promising samples, without adding fitness evaluations. The results we present demonstrate that it is possible to obtain a considerable coverage of the identities in the LFW or RFW datasets with less than 10 master faces, for six leading deep face recognition systems. In 3D, we generate faces using the 2D StyleGAN2 generator and predict a 3D structure using a deep 3D face reconstruction network. When employing two different 3D face recognition systems, we are able to obtain a coverage of 40%-50%. Additionally, we present the generation of paired 2D RGB and 3D master faces, which simultaneously match 2D and 3D models with high impersonation rates.


title: Sponsored messaging about climate change on Facebook: Actors, content, frames

abstract: Online communication about climate change is central to public discourse around this contested issue. Facebook is a dominant social media platform known to be a major source of information and online influence, yet discussion of climate change on the platform has remained largely unstudied due to difficulties in accessing data. This paper utilises Facebook's repository of social/political ads to study how climate change is framed as an issue in adverts placed by different actors. Sponsored content is a strategic investment and presumably intended to be persuasive, so patterns of who pays for adverts and how those adverts frame the issue can reveal large-scale trends in public discourse. We show that most money spent on climate-related messaging is targeted at users in the US, GB and CA. While the number of advert impressions correlates with total spend by an actor, there is a secondary effect of unpaid social sharing which can substantially affect the number of impressions per dollar spent. Most spend in the US is by political actors, while environmental non-governmental organisations dominate spend in GB. Analysis shows that climate change solutions are well represented in GB, while climate change impacts such as extreme weather events are strongly represented in the US and CA. Different actor types frame the issue of climate change in different ways; political actors position the issue as party political and a point of difference between candidates, whereas environmental NGOs frame climate change as the focus of collective action and social mobilisation. Overall, our study provides a first empirical exploration of climate-related advertising on Facebook. It shows the diversity of actors seeking to use Facebook as a platform for their campaigns and how they utilise different topic frames to persuade users to act.


title: On vertex Ramsey graphs with forbidden subgraphs

abstract: A classical vertex Ramsey result due to Ne\v{s}et\v{r}il and R\"odl states that given a finite family of graphs $\mathcal{F}$, a graph $A$ and a positive integer $r$, if every graph $B\in\mathcal{F}$ has a $2$-vertex-connected subgraph which is not a subgraph of $A$, then there exists an $\mathcal{F}$-free graph which is vertex $r$-Ramsey with respect to $A$. We prove that this sufficient condition for the existence of an $\mathcal{F}$-free graph which is vertex $r$-Ramsey with respect to $A$ is also necessary for large enough number of colours $r$. We further show a generalisation of the result to a family of graphs and the typical existence of such a subgraph in a dense binomial random graph.


title: Four-dimensional differential equations for the leading divergences of dimensionally-regulated loop integrals

abstract: We invent an automated method for computing the divergent part of Feynman integrals in dimensional regularization. Our method exploits simplifications from four-dimensional integration-by-parts identities. Leveraging algorithms from the literature, we show how to find simple differential equations for the divergent part of Feynman integrals. We illustrate the method by an application to heavy quark effective theory at three loops.


title: MIAD: A Maintenance Inspection Dataset for Unsupervised Anomaly Detection

abstract: Visual anomaly detection plays a crucial role in not only manufacturing inspection to find defects of products during manufacturing processes, but also maintenance inspection to keep equipment in optimum working condition particularly outdoors. Due to the scarcity of the defective samples, unsupervised anomaly detection has attracted great attention in recent years. However, existing datasets for unsupervised anomaly detection are biased towards manufacturing inspection, not considering maintenance inspection which is usually conducted under outdoor uncontrolled environment such as varying camera viewpoints, messy background and degradation of object surface after long-term working. We focus on outdoor maintenance inspection and contribute a comprehensive Maintenance Inspection Anomaly Detection (MIAD) dataset which contains more than 100K high-resolution color images in various outdoor industrial scenarios. This dataset is generated by a 3D graphics software and covers both surface and logical anomalies with pixel-precise ground truth. Extensive evaluations of representative algorithms for unsupervised anomaly detection are conducted, and we expect MIAD and corresponding experimental results can inspire research community in outdoor unsupervised anomaly detection tasks. Worthwhile and related future work can be spawned from our new dataset.


title: Unsupervised Continual Semantic Adaptation through Neural Rendering

abstract: An increasing amount of applications rely on data-driven models that are deployed for perception tasks across a sequence of scenes. Due to the mismatch between training and deployment data, adapting the model on the new scenes is often crucial to obtain good performance. In this work, we study continual multi-scene adaptation for the task of semantic segmentation, assuming that no ground-truth labels are available during deployment and that performance on the previous scenes should be maintained. We propose training a Semantic-NeRF network for each scene by fusing the predictions of a segmentation model and then using the view-consistent rendered semantic labels as pseudo-labels to adapt the model. Through joint training with the segmentation model, the Semantic-NeRF model effectively enables 2D-3D knowledge transfer. Furthermore, due to its compact size, it can be stored in a long-term memory and subsequently used to render data from arbitrary viewpoints to reduce forgetting. We evaluate our approach on ScanNet, where we outperform both a voxel-based baseline and a state-of-the-art unsupervised domain adaptation method.


abstract: JLab has recently found indications of the possible existence of a $\Sigma NN$ resonance at $(3.14 \pm 0.84) - i (2.28 \pm 1.2)$ MeV. In the past, using models that exploit symmetries between the two-baryon sector with and without strangeness, hyperon-nucleon interactions have been derived that reproduce the experimental data of the strangeness $-1$ sector. We make use of these interactions to review existing Faddeev studies of the $\Lambda NN$-$\Sigma NN$ system that show theoretical evidences about a $(I,J^P)=(1,1/2^+)$ $\Sigma NN$ quasibound state near threshold. The calculated position of the pole is at 2.92$\,-i\,$2.17 MeV, in reasonable agreement with the experimental findings.


title: Hidden Cooling Flows in Clusters of Galaxies II: A Wider Sample

abstract: We have recently uncovered Hidden Cooling Flows (HCFs) in the XMM RGS spectra of 3 clusters of galaxies, Centaurus, Perseus and A1835. Here we search for them in a wider sample of objects: the X-ray brightest group NGC5044; 4 moderate X-ray luminosity clusters Sersic 159, A262, A2052 and RXJ0821; and 3 high X-ray luminosity clusters RXJ1532, MACS 1931 and the Phoenix cluster. Finally we examine two Virgo elliptical galaxies, M49 and M84. All statistically allow the addition of an HCF. We find a significant detection of an HCF in 6 clusters and 2 elliptical galaxies. The hidden mass cooling rates are 5 to 40 Solar masses per year for the normal clusters, 1000 Solar masses per year or more for the extreme clusters and 1 to 2 Solar masses per year for the elliptical galaxies. We discuss the implications of the results for the composition of the innermost parts of the massive host galaxies and look forward to future observations.


title: Picking on the Same Person: Does Algorithmic Monoculture lead to Outcome Homogenization?

abstract: As the scope of machine learning broadens, we observe a recurring theme of algorithmic monoculture: the same systems, or systems that share components (e.g. training data), are deployed by multiple decision-makers. While sharing offers clear advantages (e.g. amortizing costs), does it bear risks? We introduce and formalize one such risk, outcome homogenization: the extent to which particular individuals or groups experience negative outcomes from all decision-makers. If the same individuals or groups exclusively experience undesirable outcomes, this may institutionalize systemic exclusion and reinscribe social hierarchy. To relate algorithmic monoculture and outcome homogenization, we propose the component-sharing hypothesis: if decision-makers share components like training data or specific models, then they will produce more homogeneous outcomes. We test this hypothesis on algorithmic fairness benchmarks, demonstrating that sharing training data reliably exacerbates homogenization, with individual-level effects generally exceeding group-level effects. Further, given the dominant paradigm in AI of foundation models, i.e. models that can be adapted for myriad downstream tasks, we test whether model sharing homogenizes outcomes across tasks. We observe mixed results: we find that for both vision and language settings, the specific methods for adapting a foundation model significantly influence the degree of outcome homogenization. We conclude with philosophical analyses of and societal challenges for outcome homogenization, with an eye towards implications for deployed machine learning systems.


title: Geodesic L\'evy flights and expected stopping time for random searches

abstract: We give an analytic description for the infinitesimal generator constructed by Applebaum-Estrade for L\'evy flights on a broad class of closed Riemannian manifolds including all negatively-curved manifolds, the flat torus and the sphere. Various properties of the associated semigroup and the asymptotics of the expected stopping time for L\'evy flight based random searches for small targets, also known as the narrow capture problem, are then obtained using our newfound understanding of the infinitesimal generator. Our study also relates to the L\'evy flight foraging hypothesis in the field of biology as we compute the expected time for finding a small target by using the L\'evy flight random search. A similar calculation for Brownian motion on surfaces was done in [arXiv:2209.12425].


title: ILSGAN: Independent Layer Synthesis for Unsupervised Foreground-Background Segmentation

abstract: Unsupervised foreground-background segmentation aims at extracting salient objects from cluttered backgrounds, where Generative Adversarial Network (GAN) approaches, especially layered GANs, show great promise. However, without human annotations, they are typically prone to produce foreground and background layers with non-negligible semantic and visual confusion, dubbed "information leakage", resulting in notable degeneration of the generated segmentation mask. To alleviate this issue, we propose a simple-yet-effective explicit layer independence modeling approach, termed Independent Layer Synthesis GAN (ILSGAN), pursuing independent foreground-background layer generation by encouraging their discrepancy. Specifically, it targets minimizing the mutual information between visible and invisible regions of the foreground and background to spur interlayer independence. Through in-depth theoretical and experimental analyses, we justify that explicit layer independence modeling is critical to suppressing information leakage and contributes to impressive segmentation performance gains. Also, our ILSGAN achieves strong state-of-the-art generation quality and segmentation performance on complex real-world data. Code is available at: https://github.com/qrzou/ILSGAN


title: FedGS: Federated Graph-based Sampling with Arbitrary Client Availability

abstract: While federated learning has shown strong results in optimizing a machine learning model without direct access to the original data, its performance may be hindered by intermittent client availability which slows down the convergence and biases the final learned model. There are significant challenges to achieve both stable and bias-free training under arbitrary client availability. To address these challenges, we propose a framework named Federated Graph-based Sampling (FedGS), to stabilize the global model update and mitigate the long-term bias given arbitrary client availability simultaneously. First, we model the data correlations of clients with a Data-Distribution-Dependency Graph (3DG) that helps keep the sampled clients data apart from each other, which is theoretically shown to improve the approximation to the optimal model update. Second, constrained by the far-distance in data distribution of the sampled clients, we further minimize the variance of the numbers of times that the clients are sampled, to mitigate long-term bias. To validate the effectiveness of FedGS, we conduct experiments on three datasets under a comprehensive set of seven client availability modes. Our experimental results confirm FedGS's advantage in both enabling a fair client-sampling scheme and improving the model performance under arbitrary client availability. Our code is available at \url{https://github.com/WwZzz/FedGS}.


title: Expanding Small-Scale Datasets with Guided Imagination

abstract: The power of DNNs relies heavily on the quantity and quality of training data. However, collecting and annotating data on a large scale is often expensive and time-consuming. To address this issue, we explore a new task, termed dataset expansion, aimed at expanding a ready-to-use small dataset by automatically creating new labeled samples. To this end, we present a Guided Imagination Framework (GIF) that leverages cutting-edge generative models like DALL-E2 and Stable Diffusion (SD) to "imagine" and create informative new data from the input seed data. Specifically, GIF conducts data imagination by optimizing the latent features of the seed data in the semantically meaningful space of the prior model, resulting in the creation of photo-realistic images with new content. To guide the imagination towards creating informative samples for model training, we introduce two key criteria, i.e., class-maintained information boosting and sample diversity promotion. These criteria are verified to be essential for effective dataset expansion: GIF-SD obtains 13.5% higher model accuracy on natural image datasets than unguided expansion with SD. With these essential criteria, GIF successfully expands small datasets in various scenarios, boosting model accuracy by 36.9% on average over six natural image datasets and by 13.5% on average over three medical datasets. The source code is available at https://github.com/Vanint/DatasetExpansion.


title: CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without Concrete Text Labels

abstract: Pre-trained vision-language models like CLIP have recently shown superior performances on various downstream tasks, including image classification and segmentation. However, in fine-grained image re-identification (ReID), the labels are indexes, lacking concrete text descriptions. Therefore, it remains to be determined how such models could be applied to these tasks. This paper first finds out that simply fine-tuning the visual model initialized by the image encoder in CLIP, has already obtained competitive performances in various ReID tasks. Then we propose a two-stage strategy to facilitate a better visual representation. The key idea is to fully exploit the cross-modal description ability in CLIP through a set of learnable text tokens for each ID and give them to the text encoder to form ambiguous descriptions. In the first training stage, image and text encoders from CLIP keep fixed, and only the text tokens are optimized from scratch by the contrastive loss computed within a batch. In the second stage, the ID-specific text tokens and their encoder become static, providing constraints for fine-tuning the image encoder. With the help of the designed loss in the downstream task, the image encoder is able to represent data as vectors in the feature embedding accurately. The effectiveness of the proposed strategy is validated on several datasets for the person or vehicle ReID tasks. Code is available at https://github.com/Syliz517/CLIP-ReID.


title: Extremal Area of Polygons sliding along Curves

abstract: In this paper we study the area function of polygons, where the vertices are sliding along curves. We give geometric criteria for the critical points and determine also the Hesse matrix at those points. This is the starting point for a Morse-theoretic approach, which includes the relation with the topology of the configuration spaces. Moreover the condition for extremal area gives rise to a new type of billiard: the inner area billiard.


title: BatmanNet: Bi-branch Masked Graph Transformer Autoencoder for Molecular Representation

abstract: Although substantial efforts have been made using graph neural networks (GNNs) for AI-driven drug discovery (AIDD), effective molecular representation learning remains an open challenge, especially in the case of insufficient labeled molecules. Recent studies suggest that big GNN models pre-trained by self-supervised learning on unlabeled datasets enable better transfer performance in downstream molecular property prediction tasks. However, the approaches in these studies require multiple complex self-supervised tasks and large-scale datasets, which are time-consuming, computationally expensive, and difficult to pre-train end-to-end. Here, we design a simple yet effective self-supervised strategy to simultaneously learn local and global information about molecules, and further propose a novel bi-branch masked graph transformer autoencoder (BatmanNet) to learn molecular representations. BatmanNet features two tailored complementary and asymmetric graph autoencoders to reconstruct the missing nodes and edges, respectively, from a masked molecular graph. With this design, BatmanNet can effectively capture the underlying structure and semantic information of molecules, thus improving the performance of molecular representation. BatmanNet achieves state-of-the-art results for multiple drug discovery tasks, including molecular properties prediction, drug-drug interaction, and drug-target interaction, on 13 benchmark datasets, demonstrating its great potential and superiority in molecular representation learning.


title: Sparse Hamming Graph: A Customizable Network-on-Chip Topology

abstract: Chips with hundreds to thousands of cores require scalable networks-on-chip (NoCs). Customization of the NoC topology is necessary to reach the diverse design goals of different chips. We introduce sparse Hamming graph, a novel NoC topology with an adjustable costperformance trade-off that is based on four NoC topology design principles we identified. To efficiently customize this topology, we develop a toolchain that leverages approximate floorplanning and link routing to deliver fast and accurate cost and performance predictions. We demonstrate how to use our methodology to achieve desired cost-performance trade-offs while outperforming established topologies in cost, performance, or both.